2026-09-24 22:15:30 [scrapy.utils.log] INFO: Scrapy 2.11.1 started (bot: news_scraper)
2026-09-24 22:15:30 [scrapy.utils.log] INFO: Versions: lxml 6.0.2.0, libxml2 2.14.6, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 25.5.0, Python 3.11.13 (main, Aug 12 2025, 22:39:41) [GCC 14.2.0], pyOpenSSL 25.3.0 (OpenSSL 3.5.3 16 Sep 2025), cryptography 46.0.1, Platform Linux-5.15.0-191-generic-x86_64-with
2026-09-24 22:15:30 [scrapy.addons] INFO: Enabled addons:
[]
2026-09-24 22:15:30 [asyncio] DEBUG: Using selector: EpollSelector
2026-09-24 22:15:30 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-09-24 22:15:30 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-09-24 22:15:30 [scrapy.extensions.telnet] INFO: Telnet Password: c49aa42d724b29fc
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from creating-client-class.iot-data to creating-client-class.iot-data-plane
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from before-call.apigateway to before-call.api-gateway
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from request-created.machinelearning.Predict to request-created.machine-learning.Predict
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from before-parameter-build.autoscaling.CreateLaunchConfiguration to before-parameter-build.auto-scaling.CreateLaunchConfiguration
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from before-parameter-build.route53 to before-parameter-build.route-53
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from request-created.cloudsearchdomain.Search to request-created.cloudsearch-domain.Search
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from docs.*.autoscaling.CreateLaunchConfiguration.complete-section to docs.*.auto-scaling.CreateLaunchConfiguration.complete-section
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from before-parameter-build.logs.CreateExportTask to before-parameter-build.cloudwatch-logs.CreateExportTask
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from docs.*.logs.CreateExportTask.complete-section to docs.*.cloudwatch-logs.CreateExportTask.complete-section
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from before-parameter-build.cloudsearchdomain.Search to before-parameter-build.cloudsearch-domain.Search
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Changing event name from docs.*.cloudsearchdomain.Search.complete-section to docs.*.cloudsearch-domain.Search.complete-section
2026-09-24 22:15:30 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/endpoints.json
2026-09-24 22:15:30 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/sdk-default-configuration.json
2026-09-24 22:15:30 [botocore.hooks] DEBUG: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f9010b03d80>
2026-09-24 22:15:30 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/s3/2006-03-01/service-2.json.gz
2026-09-24 22:15:31 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/s3/2006-03-01/endpoint-rule-set-1.json.gz
2026-09-24 22:15:31 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/partitions.json
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f9010c58900>
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f9010a38720>
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f9010c58680>
2026-09-24 22:15:31 [botocore.endpoint] DEBUG: Setting s3 timeout as (60, 60)
2026-09-24 22:15:31 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/_retry.json
2026-09-24 22:15:31 [botocore.client] DEBUG: Registering retry handlers for service: s3
2026-09-24 22:15:31 [botocore.utils] DEBUG: Registering S3 region redirector handler
2026-09-24 22:15:31 [botocore.utils] DEBUG: Registering S3Express Identity Resolver
2026-09-24 22:15:31 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.closespider.CloseSpider',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.throttle.AutoThrottle']
2026-09-24 22:15:31 [scrapy.crawler] INFO: Overridden settings:
{'AUTOTHROTTLE_ENABLED': True,
 'BOT_NAME': 'news_scraper',
 'CLOSESPIDER_TIMEOUT': 1800,
 'CONCURRENT_REQUESTS': 4,
 'DOWNLOAD_DELAY': 2,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/opt/scrapyd/logs/news_scraper/saostar_timestamp/698ebf14b86511f1a00e9270e2e49414.log',
 'NEWSPIDER_MODULE': 'news_scraper.spiders',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'ROBOTSTXT_OBEY': True,
 'SPIDER_MODULES': ['news_scraper.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'}
2026-09-24 22:15:31 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'news_scraper.middlewares.NewsScraperDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-09-24 22:15:31 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-09-24 22:15:31 [scrapy.middleware] INFO: Enabled item pipelines:
[]
2026-09-24 22:15:31 [scrapy.core.engine] INFO: Spider opened
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from creating-client-class.iot-data to creating-client-class.iot-data-plane
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from before-call.apigateway to before-call.api-gateway
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from request-created.machinelearning.Predict to request-created.machine-learning.Predict
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from before-parameter-build.autoscaling.CreateLaunchConfiguration to before-parameter-build.auto-scaling.CreateLaunchConfiguration
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from before-parameter-build.route53 to before-parameter-build.route-53
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from request-created.cloudsearchdomain.Search to request-created.cloudsearch-domain.Search
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from docs.*.autoscaling.CreateLaunchConfiguration.complete-section to docs.*.auto-scaling.CreateLaunchConfiguration.complete-section
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from before-parameter-build.logs.CreateExportTask to before-parameter-build.cloudwatch-logs.CreateExportTask
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from docs.*.logs.CreateExportTask.complete-section to docs.*.cloudwatch-logs.CreateExportTask.complete-section
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from before-parameter-build.cloudsearchdomain.Search to before-parameter-build.cloudsearch-domain.Search
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Changing event name from docs.*.cloudsearchdomain.Search.complete-section to docs.*.cloudsearch-domain.Search.complete-section
2026-09-24 22:15:31 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/endpoints.json
2026-09-24 22:15:31 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/sdk-default-configuration.json
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f9010b03d80>
2026-09-24 22:15:31 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/s3/2006-03-01/service-2.json.gz
2026-09-24 22:15:31 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/s3/2006-03-01/endpoint-rule-set-1.json.gz
2026-09-24 22:15:31 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/partitions.json
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f9010c58900>
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f900fad1620>
2026-09-24 22:15:31 [botocore.hooks] DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f9010c58680>
2026-09-24 22:15:31 [botocore.endpoint] DEBUG: Setting s3 timeout as (60, 60)
2026-09-24 22:15:31 [botocore.loaders] DEBUG: Loading JSON file: /usr/local/lib/python3.11/site-packages/botocore/data/_retry.json
2026-09-24 22:15:31 [botocore.client] DEBUG: Registering retry handlers for service: s3
2026-09-24 22:15:31 [botocore.utils] DEBUG: Registering S3 region redirector handler
2026-09-24 22:15:31 [botocore.utils] DEBUG: Registering S3Express Identity Resolver
2026-09-24 22:15:31 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-09-24 22:15:31 [saostar_timestamp] INFO: Spider opened: saostar_timestamp
2026-09-24 22:15:31 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-09-24 22:15:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/robots.txt> (referer: None)
2026-09-24 22:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/> (referer: None)
2026-09-24 22:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/tin-moi/> (referer: https://www.saostar.vn/)
2026-09-24 22:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/steven-nguyen-lap-ky-luc-202609241728109226.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:15:43 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/steven-nguyen-lap-ky-luc-202609241728109226.html
2026-09-24 22:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/bach-loc-tang-qua-gia-tri-lon-cho-nhan-vien-202609241728235767.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:15:45 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/bach-loc-tang-qua-gia-tri-lon-cho-nhan-vien-202609241728235767.html
2026-09-24 22:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/am-nhac/taylor-swift-dung-truoc-loat-ky-luc-chua-tung-co-tai-mtv-vm-as-2026-202609241602114277.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:15:46 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/am-nhac/taylor-swift-dung-truoc-loat-ky-luc-chua-tung-co-tai-mtv-vm-as-2026-202609241602114277.html
2026-09-24 22:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/vo-jang-dong-gun-tiet-lo-mot-dieu-gay-hut-hang-o-tuoi-54-202609241554036728.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:15:49 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/giai-tri/vo-jang-dong-gun-tiet-lo-mot-dieu-gay-hut-hang-o-tuoi-54-202609241554036728.html
2026-09-24 22:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/jo-in-sung-bi-that-lac-hanh-ly-khi-den-y-202609241428096594.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:15:51 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/giai-tri/jo-in-sung-bi-that-lac-hanh-ly-khi-den-y-202609241428096594.html
2026-09-24 22:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sac-mau-cuoc-song/nguoi-phu-nu-lao-vao-dai-phan-cach-xem-camera-hanh-trinh-ai-cung-ngan-202609241437351249.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:15:53 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/sac-mau-cuoc-song/nguoi-phu-nu-lao-vao-dai-phan-cach-xem-camera-hanh-trinh-ai-cung-ngan-202609241437351249.html
2026-09-24 22:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/am-nhac/taylor-swift-doi-y-tung-them-4-ca-khuc-moi-202609241406213823.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:15:56 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/am-nhac/taylor-swift-doi-y-tung-them-4-ca-khuc-moi-202609241406213823.html
2026-09-24 22:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/quach-ngoc-ngoan-da-tim-duoc-hanh-phuc-o-tuoi-42-202609241442219499.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:15:59 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/quach-ngoc-ngoan-da-tim-duoc-hanh-phuc-o-tuoi-42-202609241442219499.html
2026-09-24 22:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/oc-thanh-van-len-tieng-202609241454427361.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:00 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/oc-thanh-van-len-tieng-202609241454427361.html
2026-09-24 22:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/ninh-duong-lan-ngoc-len-tieng-khi-lam-viec-voi-ky-duyen-va-chi-pu-202609241500342563.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:03 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/giai-tri/ninh-duong-lan-ngoc-len-tieng-khi-lam-viec-voi-ky-duyen-va-chi-pu-202609241500342563.html
2026-09-24 22:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/tai-san-cua-dien-vien-dong-te-cong-truoc-khi-qua-doi-202609241524390392.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:06 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/tai-san-cua-dien-vien-dong-te-cong-truoc-khi-qua-doi-202609241524390392.html
2026-09-24 22:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/dang-mung-cho-nsut-huu-chau-202609241530202143.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:08 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/dang-mung-cho-nsut-huu-chau-202609241530202143.html
2026-09-24 22:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/cuoc-doi-cua-dien-vien-dong-te-cong-truoc-khi-qua-doi-202609241536581145.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:10 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/cuoc-doi-cua-dien-vien-dong-te-cong-truoc-khi-qua-doi-202609241536581145.html
2026-09-24 22:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/the-scandal-van-lot-top-10-netflix-toan-cau-mac-tranh-cai-bua-vay-202609241546448567.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:13 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/the-scandal-van-lot-top-10-netflix-toan-cau-mac-tranh-cai-bua-vay-202609241546448567.html
2026-09-24 22:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sac-mau-cuoc-song/dot-mua-lon-o-mien-trung-keo-dai-den-bao-gio-202609241550541077.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:15 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/sac-mau-cuoc-song/dot-mua-lon-o-mien-trung-keo-dai-den-bao-gio-202609241550541077.html
2026-09-24 22:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sac-mau-cuoc-song/trung-thu-di-tim-trang-dua-ca-gia-dinh-tro-lai-ky-uc-tuoi-tho-202609241553498057.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:17 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/sac-mau-cuoc-song/trung-thu-di-tim-trang-dua-ca-gia-dinh-tro-lai-ky-uc-tuoi-tho-202609241553498057.html
2026-09-24 22:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/mung-cho-hanh-phuc-cua-cat-tuong-o-tuoi-48-202609241548479483.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:20 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/mung-cho-hanh-phuc-cua-cat-tuong-o-tuoi-48-202609241548479483.html
2026-09-24 22:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/am-nhac/jennie-dat-duoc-thu-hang-cao-nhat-trong-su-nghiep-202609241549558203.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:21 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/am-nhac/jennie-dat-duoc-thu-hang-cao-nhat-trong-su-nghiep-202609241549558203.html
2026-09-24 22:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sac-mau-cuoc-song/gia-xang-dau-tang-manh-202609241604197522.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:24 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/sac-mau-cuoc-song/gia-xang-dau-tang-manh-202609241604197522.html
2026-09-24 22:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sac-mau-cuoc-song/nguoi-viet-chi-gan-160-ti-dong-mua-banh-trung-thu-online-202609241629007437.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:26 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/sac-mau-cuoc-song/nguoi-viet-chi-gan-160-ti-dong-mua-banh-trung-thu-online-202609241629007437.html
2026-09-24 22:16:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sac-mau-cuoc-song/lang-thang-with-phat-nhip-cau-mang-lop-hoc-va-ao-am-den-tre-em-yeu-202609231550108159.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:28 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/sac-mau-cuoc-song/lang-thang-with-phat-nhip-cau-mang-lop-hoc-va-ao-am-den-tre-em-yeu-202609231550108159.html
2026-09-24 22:16:31 [scrapy.extensions.logstats] INFO: Crawled 24 pages (at 24 pages/min), scraped 0 items (at 0 items/min)
2026-09-24 22:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sac-mau-cuoc-song/tai-sao-an-cay-lai-chay-nuoc-mui-202609241636435297.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:31 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/sac-mau-cuoc-song/tai-sao-an-cay-lai-chay-nuoc-mui-202609241636435297.html
2026-09-24 22:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/guong-mat-thuong-hieu/lamoon-hoa-chan-nhi-visual-tinh-dau-quoc-dan-khien-cong-dong-vo-lam-202609241644540366.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:34 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/guong-mat-thuong-hieu/lamoon-hoa-chan-nhi-visual-tinh-dau-quoc-dan-khien-cong-dong-vo-lam-202609241644540366.html
2026-09-24 22:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/mac-van-khoa-tiet-lo-thay-doi-lon-cua-lam-vy-da-202609241657432196.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:37 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/mac-van-khoa-tiet-lo-thay-doi-lon-cua-lam-vy-da-202609241657432196.html
2026-09-24 22:16:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/nhung-vai-dien-noi-tieng-cua-du-bon-xuong-truoc-khi-qua-doi-202609241658218639.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:39 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/nhung-vai-dien-noi-tieng-cua-du-bon-xuong-truoc-khi-qua-doi-202609241658218639.html
2026-09-24 22:16:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/hinh-anh-khong-ngo-lien-quan-ly-lien-kiet-202609241658422737.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:41 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/hinh-anh-khong-ngo-lien-quan-ly-lien-kiet-202609241658422737.html
2026-09-24 22:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/dien-vien-hong-dao-gio-to-san-khau-o-my-202609241553414824.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:44 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/giai-tri/dien-vien-hong-dao-gio-to-san-khau-o-my-202609241553414824.html
2026-09-24 22:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sao-sport/u23-thai-lan-quyet-loai-u23-trung-quoc-202609241702280736.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:47 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/sao-sport/u23-thai-lan-quyet-loai-u23-trung-quoc-202609241702280736.html
2026-09-24 22:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/dien-anh/thanh-tich-lon-cua-nghe-si-hong-dao-sau-3-nam-202609241709340682.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:49 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/dien-anh/thanh-tich-lon-cua-nghe-si-hong-dao-sau-3-nam-202609241709340682.html
2026-09-24 22:16:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/chau-trai-dolly-parton-bi-kien-202609241646362842.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:52 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/giai-tri/chau-trai-dolly-parton-bi-kien-202609241646362842.html
2026-09-24 22:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/vong-quanh-the-gioi/tham-phan-my-yeu-cau-trump-khoi-phuc-quyen-tiep-can-nha-trang-cho-cnn-202609241519130397.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:55 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/vong-quanh-the-gioi/tham-phan-my-yeu-cau-trump-khoi-phuc-quyen-tiep-can-nha-trang-cho-cnn-202609241519130397.html
2026-09-24 22:16:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/nguoi-mau-hoa-hau/dai-dien-viet-nam-nhan-ket-qua-dang-tiec-o-miss-grand-international-202609241627034939.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:16:57 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/nguoi-mau-hoa-hau/dai-dien-viet-nam-nhan-ket-qua-dang-tiec-o-miss-grand-international-202609241627034939.html
2026-09-24 22:17:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/am-nhac/lisa-gay-tranh-cai-vi-uong-ruou-tren-truyen-hinh-my-202609241759236555.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:17:00 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/am-nhac/lisa-gay-tranh-cai-vi-uong-ruou-tren-truyen-hinh-my-202609241759236555.html
2026-09-24 22:17:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sao-hoc-duong/lo-dien-4-tan-thu-khoa-dau-vao-truong-dh-kinh-te-tai-chinh-tp-hcm-202609241930084834.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:17:02 [saostar_timestamp] INFO: 2026-09-24 is out of date range: from 2026-09-25 to 2026-09-25, skipping article: https://www.saostar.vn/sao-hoc-duong/lo-dien-4-tan-thu-khoa-dau-vao-truong-dh-kinh-te-tai-chinh-tp-hcm-202609241930084834.html
2026-09-24 22:17:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/hanh-phuc-den-muon-voi-nsnd-hong-van-sau-so-tien-85-ty-dong-202609242337140972.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:17:04 [saostar_timestamp] INFO: 2026-09-25 00:00:00 smaller than 2026-09-25 04:55:00
2026-09-24 22:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/den-vau-da-dung-cam-khi-chon-xa-hoang-thuy-linh-sau-3-nam-thanh-doi-202609242341278607.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:17:06 [saostar_timestamp] INFO: 2026-09-25 00:15:59.467000 smaller than 2026-09-25 04:55:00
2026-09-24 22:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/ly-hai-va-minh-ha-can-dam-vi-da-chon-chia-tay-sau-10-nam-202609250013250095.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:17:09 [saostar_timestamp] INFO: 2026-09-25 04:00:00 smaller than 2026-09-25 04:55:00
2026-09-24 22:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/phuong-oanh-da-dung-khi-chon-bat-dau-lai-o-tuoi-37-202609250024282647.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:17:12 [saostar_timestamp] INFO: 2026-09-25 04:30:00 smaller than 2026-09-25 04:55:00
2026-09-24 22:17:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/giai-tri/hoa-minzy-phan-ung-ve-ngay-vui-cua-my-tam-202609250022262495.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:17:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.saostar.vn/giai-tri/hoa-minzy-phan-ung-ve-ngay-vui-cua-my-tam-202609250022262495.html> (referer: https://www.saostar.vn/tin-moi/)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 279, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 350, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 350, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/offsite.py", line 28, in <genexpr>
    return (r for r in result or () if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 352, in <genexpr>
    return (self._set_referer(r, response) for r in result or ())
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 27, in <genexpr>
    return (r for r in result or () if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 31, in <genexpr>
    return (r for r in result or () if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/opt/scrapy_projects/news_scraper/spiders/saostar_timestamp_spider.py", line 90, in parse_article
    if item["content"]:
       ~~~~^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/item.py", line 79, in __getitem__
    return self._values[key]
           ~~~~~~~~~~~~^^^^^
KeyError: 'content'
2026-09-24 22:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.saostar.vn/sac-mau-cuoc-song/3-con-giap-thuong-bi-xem-nhe-nhung-lai-am-tham-tien-rat-xa-202609242230110001.html> (referer: https://www.saostar.vn/tin-moi/)
2026-09-24 22:17:17 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.saostar.vn/sac-mau-cuoc-song/3-con-giap-thuong-bi-xem-nhe-nhung-lai-am-tham-tien-rat-xa-202609242230110001.html> (referer: https://www.saostar.vn/tin-moi/)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 279, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 350, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 350, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/offsite.py", line 28, in <genexpr>
    return (r for r in result or () if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 352, in <genexpr>
    return (self._set_referer(r, response) for r in result or ())
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 27, in <genexpr>
    return (r for r in result or () if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 31, in <genexpr>
    return (r for r in result or () if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/opt/scrapy_projects/news_scraper/spiders/saostar_timestamp_spider.py", line 90, in parse_article
    if item["content"]:
       ~~~~^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/item.py", line 79, in __getitem__
    return self._values[key]
           ~~~~~~~~~~~~^^^^^
KeyError: 'content'
2026-09-24 22:17:17 [scrapy.core.engine] INFO: Closing spider (finished)
2026-09-24 22:17:17 [boto3.s3.transfer] DEBUG: Opting out of CRT Transfer Manager. Preferred client: auto, CRT available: False, Instance Optimized: False.
2026-09-24 22:17:17 [boto3.s3.transfer] DEBUG: Using default client. pid: 51667, thread: 140256712227640
2026-09-24 22:17:17 [s3transfer.utils] DEBUG: Acquiring 0
2026-09-24 22:17:17 [s3transfer.tasks] DEBUG: UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f90106584d0>}) about to wait for the following futures []
2026-09-24 22:17:17 [s3transfer.tasks] DEBUG: UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f90106584d0>}) done waiting for dependent futures
2026-09-24 22:17:17 [s3transfer.tasks] DEBUG: Executing task UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f90106584d0>}) with kwargs {'client': <botocore.client.S3 object at 0x7f901057fd90>, 'config': <boto3.s3.transfer.TransferConfig object at 0x7f90105c0d90>, 'osutil': <s3transfer.utils.OSUtils object at 0x7f90105c0850>, 'request_executor': <s3transfer.futures.BoundedExecutor object at 0x7f90105c0790>, 'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f90106584d0>}
2026-09-24 22:17:17 [s3transfer.futures] DEBUG: Submitting task PutObjectTask(transfer_id=0, {'bucket': 'dagster-output-data', 'key': 'saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'extra_args': {}}) to executor <s3transfer.futures.BoundedExecutor object at 0x7f90105c0790> for transfer request: 0.
2026-09-24 22:17:17 [s3transfer.utils] DEBUG: Acquiring 0
2026-09-24 22:17:17 [s3transfer.tasks] DEBUG: PutObjectTask(transfer_id=0, {'bucket': 'dagster-output-data', 'key': 'saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'extra_args': {}}) about to wait for the following futures []
2026-09-24 22:17:17 [s3transfer.utils] DEBUG: Releasing acquire 0/None
2026-09-24 22:17:17 [s3transfer.tasks] DEBUG: PutObjectTask(transfer_id=0, {'bucket': 'dagster-output-data', 'key': 'saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'extra_args': {}}) done waiting for dependent futures
2026-09-24 22:17:17 [s3transfer.tasks] DEBUG: Executing task PutObjectTask(transfer_id=0, {'bucket': 'dagster-output-data', 'key': 'saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'extra_args': {}}) with kwargs {'client': <botocore.client.S3 object at 0x7f901057fd90>, 'fileobj': <s3transfer.utils.ReadFileChunk object at 0x7f900fc927d0>, 'bucket': 'dagster-output-data', 'key': 'saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'extra_args': {}}
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f9010b16520>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f9010b15800>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f9010b16f20>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f9010b15760>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f9010b17920>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90106550d0>>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-parameter-build.s3.PutObject: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f90105b1a10>>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f9010b15580>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f9010b17b00>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90106550d0>>
2026-09-24 22:17:17 [botocore.regions] DEBUG: Calling endpoint provider with parameters: {'Bucket': 'dagster-output-data', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'https://lake-api.actable.ai/', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'Key': 'saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2026-09-24 22:17:17 [botocore.regions] DEBUG: Endpoint provider result: https://lake-api.actable.ai/dagster-output-data
2026-09-24 22:17:17 [botocore.regions] DEBUG: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2026-09-24 22:17:17 [botocore.regions] DEBUG: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_checksum at 0x7f9010f7cc20>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f9010b15b20>
2026-09-24 22:17:17 [botocore.handlers] DEBUG: Adding expect 100 continue header to request.
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-call.s3.PutObject: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f9010658c50>>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f9010b03e20>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f9010b17060>
2026-09-24 22:17:17 [botocore.endpoint] DEBUG: Making request for OperationModel(name=PutObject) with params: {'url_path': '/saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.34.57 md/Botocore#1.34.162 ua/2.0 os/linux#5.15.0-191-generic md/arch#x86_64 lang/python#3.11.13 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.162', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Expect': '100-continue'}, 'body': <s3transfer.utils.ReadFileChunk object at 0x7f900fc927d0>, 'auth_path': '/dagster-output-data/saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'url': 'https://lake-api.actable.ai/dagster-output-data/saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7f9010665e90>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'dagster-output-data', 'params': {'Bucket': 'dagster-output-data', 'Key': 'saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl', 'Body': <s3transfer.utils.ReadFileChunk object at 0x7f900fc927d0>}}, 'input_params': {'Bucket': 'dagster-output-data', 'Key': 'saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl'}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'us-east-1'}]}}}
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event request-created.s3.PutObject: calling handler <function signal_not_transferring at 0x7f900fe0ff60>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f9010665e50>>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f90105b1a10>>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f9010b15440>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f9010b17a60>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event before-sign.s3.PutObject: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f9010658c50>>
2026-09-24 22:17:17 [botocore.auth] DEBUG: Calculating signature using v4 auth.
2026-09-24 22:17:17 [botocore.auth] DEBUG: CanonicalRequest:
PUT
/dagster-output-data/saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl

content-md5:1B2M2Y8AsgTpgAmY7PhCfg==
host:lake-api.actable.ai
x-amz-content-sha256:UNSIGNED-PAYLOAD
x-amz-date:20260924T221717Z

content-md5;host;x-amz-content-sha256;x-amz-date
UNSIGNED-PAYLOAD
2026-09-24 22:17:17 [botocore.auth] DEBUG: StringToSign:
AWS4-HMAC-SHA256
20260924T221717Z
20260924/us-east-1/s3/aws4_request
9f24502873668b493a6a724b20e6102664ae09f0a38bd6d21b3e6aa98723f8ae
2026-09-24 22:17:17 [botocore.auth] DEBUG: Signature:
a67ce0ced2e3adca125b99f61ddf5d55401065b2084c246f58ebaee549bd48f1
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event request-created.s3.PutObject: calling handler <function signal_transferring at 0x7f900fe2c040>
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f9010b17880>
2026-09-24 22:17:17 [botocore.endpoint] DEBUG: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=https://lake-api.actable.ai/dagster-output-data/saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl, headers={'User-Agent': b'Boto3/1.34.57 md/Botocore#1.34.162 ua/2.0 os/linux#5.15.0-191-generic md/arch#x86_64 lang/python#3.11.13 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.162', 'Content-MD5': b'1B2M2Y8AsgTpgAmY7PhCfg==', 'Expect': b'100-continue', 'X-Amz-Date': b'20260924T221717Z', 'X-Amz-Content-SHA256': b'UNSIGNED-PAYLOAD', 'Authorization': b'AWS4-HMAC-SHA256 Credential=9zTeMQWwQiGhbKvMJ7uq/20260924/us-east-1/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=a67ce0ced2e3adca125b99f61ddf5d55401065b2084c246f58ebaee549bd48f1', 'amz-sdk-invocation-id': b'dbc9b9ed-05cd-4f09-8e4b-2d840916092f', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2026-09-24 22:17:17 [botocore.httpsession] DEBUG: Certificate path: /usr/local/lib/python3.11/site-packages/certifi/cacert.pem
2026-09-24 22:17:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): lake-api.actable.ai:443
2026-09-24 22:17:17 [botocore.awsrequest] DEBUG: Waiting for 100 Continue response.
2026-09-24 22:17:17 [botocore.awsrequest] DEBUG: 100 Continue response seen, now sending request body.
2026-09-24 22:17:17 [urllib3.connectionpool] DEBUG: https://lake-api.actable.ai:443 "PUT /dagster-output-data/saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl HTTP/1.1" 200 0
2026-09-24 22:17:17 [botocore.parsers] DEBUG: Response headers: {'Server': 'nginx/1.18.0 (Ubuntu)', 'Date': 'Thu, 24 Sep 2026 22:17:17 GMT', 'Content-Length': '0', 'Connection': 'keep-alive', 'Accept-Ranges': 'bytes', 'ETag': '"d41d8cd98f00b204e9800998ecf8427e"', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Vary': 'Origin, Accept-Encoding', 'X-Amz-Bucket-Region': 'us-east-1', 'X-Amz-Id-2': 'dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8', 'X-Amz-Request-Id': '18D861AAC1E90D9A', 'X-Content-Type-Options': 'nosniff', 'X-Ratelimit-Limit': '93243', 'X-Ratelimit-Remaining': '93243', 'X-Xss-Protection': '1; mode=block'}
2026-09-24 22:17:17 [botocore.parsers] DEBUG: Response body:
b''
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f9010658b10>
2026-09-24 22:17:17 [botocore.retryhandler] DEBUG: No retry needed.
2026-09-24 22:17:17 [botocore.hooks] DEBUG: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90106550d0>>
2026-09-24 22:17:17 [s3transfer.utils] DEBUG: Releasing acquire 0/None
2026-09-24 22:17:17 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (0 items) in: s3://dagster-output-data/saostar_timestamp/saostar_timestamp_698ebf14b86511f1a00e9270e2e49414_scheduled_2026-09-25.jl
2026-09-24 22:17:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 14398,
 'downloader/request_count': 43,
 'downloader/request_method_count/GET': 43,
 'downloader/response_bytes': 474102,
 'downloader/response_count': 43,
 'downloader/response_status_count/200': 43,
 'elapsed_time_seconds': 106.713159,
 'feedexport/success_count/S3FeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 9, 24, 22, 17, 17, 836061, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 1732392,
 'httpcompression/response_count': 43,
 'log_count/DEBUG': 153,
 'log_count/ERROR': 2,
 'log_count/INFO': 51,
 'memusage/max': 128290816,
 'memusage/startup': 123600896,
 'request_depth_max': 2,
 'response_received_count': 43,
 'robotstxt/request_count': 1,
 'robotstxt/response_count': 1,
 'robotstxt/response_status_count/200': 1,
 'scheduler/dequeued': 42,
 'scheduler/dequeued/memory': 42,
 'scheduler/enqueued': 42,
 'scheduler/enqueued/memory': 42,
 'spider_exceptions/KeyError': 2,
 'start_time': datetime.datetime(2026, 9, 24, 22, 15, 31, 122902, tzinfo=datetime.timezone.utc)}
2026-09-24 22:17:17 [scrapy.core.engine] INFO: Spider closed (finished)