Project Detail
GreyLockGreen
Project Overview:
Year
2024
Technologies
Python, Django, Selenium, Beautifulsoup, Pandas, SQL-Alchemy, Linux, SQL, PostgreSQL, React, NGINX
Preview
Preview is private or not published.
Repository
Repository is private or not attached here.
Overview
Project Notes
The original content remains intact, but the reading flow is now cleaner and easier to scan.
Project Overview:
A scalable Django-based platform with advanced scraping, reporting, and user management features.
Core Features:
User-friendly dashboard built with Django.
Custom report generation with email delivery.
Password recovery and multi-user support.
AI-powered product query responses.
Bulk upload, sold-out alerts, and new product tracking.
Geographic filtering (city, state, zip).
Scraping Infrastructure:
High-capacity scrapers (thousands of requests/day).
Regional deployment (West, Central, East).
Centralized data storage.
Database & Performance:
Migrated to PostgreSQL with master-slave replication.
TimescaleDB (optional), parallel query tuning.
PgBouncer for efficient connection pooling.
Regular VACUUM/ANALYZE and S3 backups.
DevOps & Deployment:
Dockerized app with permanent subdomain.
Mail server for notifications and reports.
Full logging and contact page.
Gallery
Project Screenshots
Visual walkthroughs and screens for the selected project.
