Quick Summary
Amr Samir, Full Stack Developer & Technical Architect, built this project using Node.js, Express, MongoDB, TypeScript, Socket.io. It demonstrates professional-grade implementation of modern web solutions with a focus on performance and scalability.
JobFlow Automation - Automated Freelance Scraper & WhatsApp Notification Engine
5 Skills • 2026
An automated job scraping daemon and WhatsApp event dispatcher built to monitor freelance job portals in real time and broadcast instant lead notifications to target developer groups.
github.com
Slide 0 of 0
What this project demonstrates
Technical Specifications
- Project Type: Web Application
- Primary Stack: Node.js, Express, MongoDB
- Deployment: Secure VPS / Cloud Infrastructure
- Architecture: Modern Decoupled Architecture
Core Value Delivery
Delivering scalable, high-performance solutions with a focus on user experience and business growth.
Quick project inquiry
Send a simple inquiry directly from the project page without leaving for the hire page.
Project Overview
JobFlow Automation: Automated Freelance Scraper & WhatsApp Notification Engine
Problem & Engineering Goal
In competitive freelance software engineering markets, response speed is crucial for securing client contracts. Manually checking job platforms like Upwork and Freelancer throughout the day is inefficient and leads to missed proposal submission windows.
JobFlow Automation was engineered to automate job discovery. The system continuously polls target job boards, parses listing metadata, filters jobs against developer preferences (keywords, hourly rates, budget thresholds), and immediately broadcasts formatted job alerts directly to active WhatsApp developer groups.
Architectural Highlights
- Multi-Source Scraping Engine: Decoupled scraping modules using Cheerio for static HTML parsing and Puppeteer for JavaScript-rendered job portals.
- Native WhatsApp Socket Dispatcher: Integrated
@whiskeysockets/baileysto manage a persistent WhatsApp Web socket daemon inside Node.js, dispatching notifications without per-message SMS gateway costs. - Deduplication & State Persistence: Logs scraped job IDs to MongoDB with unique index boundaries, ensuring the same job listing is never dispatched twice.
- Keyword & Rule Filtering: Configurable matching rules filtering by project category, minimum budget, and client verification status.
Technical Trade-offs & Lessons
- WebSocket State Resiliency: Mobile network disconnects or process restarts required implementing atomic auth file saving (
baileys_auth/) and exponential backoff reconnection timers. - Rate-Limiting Protection: Added message queues and randomized delay intervals between broadcasts to avoid triggering WhatsApp socket rate limits.
Related Resources
- Technologies: NONode.js, EXExpress.js, MOMongoDB, SOSocket.IO
- Direct Contact: Contact Me
