Open source idle fish purchase task monitoring system, real-time monitoring of demand commodity analysis with web interface

Project Highlights

• Visual web interface: Provides a complete Web UI, supporting visual management of tasks, online editing of AI standards, real-time viewing of running logs, and filtering and browsing of results, without the need to directly operate the command line and configuration files.
• AI-driven task creation: Just describe your purchase needs in natural language, and you can create a new monitoring task containing complex filtering logic with one click.
• Multitasking concurrently: pass config.jsonMonitor multiple keywords at the same time, and each task runs independently without interfering with each other.
• real-time streaming: After discovering new products, immediately enter the analysis process and say goodbye to batch processing delays.
• Deep AI analysis: Integrate multi-modal large language models (such as GPT-4o), combine product images and seller portraits for in-depth analysis and precise screening.
• Highly customizable: Each monitoring task can be configured with independent keywords, price ranges, filter conditions and AI analysis instructions (Prompt).
• Instant notification: Immediately push products that meet AI recommendations to your mobile phone or desktop through ntfy.sh.
• Robust anti-crawling strategy: Simulates real-person operation, including a variety of random delays and user behaviors to improve stability.

Web UI features at a glance

• task management:
  • AI creation task: Use natural language to describe requirements and generate monitoring tasks and supporting AI analysis standards with one click.
  • Visual editing: Modify task parameters directly in the form, such as keywords, price range, etc.
  • Start/stop control: Independently control the enable/disable status of each task, or start and stop all tasks with one click.
• View results:
  • Card browsing: Clearly display each eligible product in the form of graphic cards.
  • Smart filtering: You can filter out all products marked as “recommended” by AI with one click.
  • Depth details: View the complete crawl data and detailed JSON results of AI analysis for each item.
• Run log:
  • real-time log streaming: View detailed logs of crawler operations in real time on the web page to facilitate tracking progress and troubleshooting problems.
• System settings:
  • status check: One-click check.envWhether key dependencies such as configuration and login status are normal.
  • Prompt online editing: Edit and save for AI analysis directly on the web pagepromptFile, adjust AI’s thinking logic in real time.