playwright-service-1 | ================= Scrape Request ================= api-1 | nuq-worker-2 2025-11-23 18:49:30 info [ScrapeURL:]: Scraping URL "the url"... playwright-service-1 | URL: ... api-1 | nuq-worker-2 2025-11-23 18:49:30 info [ScrapeURL:]: Selected engines playwright-service-1 | Wait After Load: 2000 api-1 | nuq-worker-2 2025-11-23 18:49:30 info [ScrapeURL:]: Scraping via playwright... playwright-service-1 | Timeout: 19999 playwright-service-1 | Headers: None playwright-service-1 | Check Selector: None playwright-service-1 | Skip TLS Verification: true playwright-service-1 | ================================================== playwright-service-1 | :warning: WARNING: No proxy server provided. Your IP address may be blocked. playwright-service-1 | Attempting strategy 1: Normal load playwright-service-1 | Navigating to .... with waitUntil: load and timeout: 19999ms playwright-service-1 | :white_check_mark: Scrape successful! api-1 | nuq-worker-2 2025-11-23 18:49:32 info [ScrapeURL:]: Scrape via playwright deemed successful. api-1 | nuq-worker-2 2025-11-23 18:49:32 info [:]: Model: gpt-4o-mini | hasRef: false api-1 | nuq-worker-2 2025-11-23 18:49:32 info [ScrapeURL:performLLMExtract/generateCompletions]: No recursive references detected, resolving refs api-1 | nuq-worker-2 2025-11-23 18:49:32 info [ScrapeURL:performLLMExtract/generateCompletions]: Resolved schema refs api-1 | nuq-worker-2 2025-11-23 18:49:32 info [ScrapeURL:performLLMExtract/generateCompletions]: Wrapping original schema with SmartScrape fields. api-1 | nuq-worker-2 2025-11-23 18:49:32 info [ScrapeURL:performLLMExtract/generateCompletions]: Generated schema from prompt api-1 | nuq-worker-2 2025-11-23 18:49:32 debug [ScrapeURL:performLLMExtract/generateCompletions]: Generating object... api-1 | api 2025-11-23 18:49:36 info [:GET]: v2 request completed api-1 | api 2025-11-23 18:49:40 info [:GET]: v2 request completed api-1 | nuq-worker-2 2025-11-23 18:49:45 info [nuq-worker:]: Renewing lock api-1 | nuq-worker-2 2025-11-23 18:49:45 info [nuq-worker:]: Renewed lock api-1 | nuq-worker-2 2025-11-23 18:49:47 info [ScrapeURL:performLLMExtract/generateCompletions]: Smart schema resolved api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [ScrapeURL:executeTransformers/performLLMExtract]: Assigning extracted data api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [ScrapeURL:]: Executed transformers. api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [scrapeURL/metrics:]: scrapeURL metrics api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [WebCrawler:importRobotsTxt]: Processed robots.txt api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [queue-worker:processJob]: Discovered 29 links... api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [queue-worker:processJob]: Logging job to DB... api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [queue-worker:processJob]: Calling webhook with success... api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [queue-worker:processJob]: Declaring job as done... api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [crawl-redis:addCrawlJobDone]: Adding done crawl job to Redis... api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [crawl-redis:finishCrawlPre]: Marking crawl as pre-finished. api-1 | nuq-worker-2 2025-11-23 18:49:47 info [queue-worker:finishCrawlIfNeeded]: Crawl is pre-finished, checking if we need to add more jobs api-1 | nuq-worker-2 2025-11-23 18:49:47 info [queue-worker:finishCrawlIfNeeded]: Visited URLs api-1 | nuq-worker-2 2025-11-23 18:49:47 info [queue-worker:finishCrawlIfNeeded]: Last URLs api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [WebCrawler:importRobotsTxt]: Processed robots.txt api-1 | nuq-worker-2 2025-11-23 18:49:47 info [queue-worker:finishCrawlIfNeeded]: Finishing crawl api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [crawl-redis:finishCrawl]: Marking crawl as finished. api-1 | nuq-worker-2 2025-11-23 18:49:47 info [queue-worker:processJob]: :ox: Job done 4b07537f-ce73-4d51-88b.... api-1 | nuq-worker-2 2025-11-23 18:49:47 debug [queue-worker:processJobInternal]: Job succeeded -- putting result in Redis api-1 | api 2025-11-23 18:50:03 info [:GET]: v2 request completed