Web Scraping
My Journey into Ethical Web Scraping with Python
Best practices for responsible web scraping, including respecting robots.txt, rate limiting, and legal considerations when extracting data from websites.
~/abdur-rafay
$
AI Engineer
Crafting
Intelligent Systems
with AI & Code
I'm Abdur Rafay, an AI Engineer at Lythe Labs. I build production-grade LLM applications, RAG pipelines, and multi-agent systems, with experience shipping 25+ AI agents across healthcare, finance, and education.
25+
AI Agents Shipped
5+
Internships
10+
Open Source Projects
class AIEngineer:
def __init__(self):
self.name = "Abdur Rafay"
self.major = "Artificial Intelligence"
self.skills = ["Python", "AI/ML", "React"]
01
About Me
Get to know the person behind the code
Hello! I'm Abdur Rafay
I'm an AI Engineer currently working at Lythe Labs (Singapore, Remote) building production-grade LLM applications, RAG pipelines, and multi-agent systems. I've shipped 25+ AI agents across healthcare, finance, and education domains.
I'm pursuing my BS in Artificial Intelligence at Bahria University while working across 5+ international internships, from Cairo to Georgia, Dubai to Lahore. I thrive at the intersection of research and engineering: taking ideas from paper to production.
Education
BS Artificial Intelligence, Bahria University (2024-Present)
Location
Wah Cantt, Pakistan
Specialization
LLMs, Multi-Agent Systems, RAG Pipelines
02
Services
What I can do for you
AI/ML Development
Building intelligent systems using machine learning and deep learning. Experienced with LLMs, prompt engineering, fine-tuning, and working with TensorFlow and PyTorch.
- Large Language Models (LLMs)
- Prompt Engineering & Fine-tuning
- TensorFlow & PyTorch
- AI-Powered Applications
Full-Stack Web Development
Creating modern web applications using Flask, Django, React, and modern frontend technologies. From backend APIs to responsive user interfaces.
- Flask & Django Backend
- React & Vite Frontend
- RESTful API Development
- Responsive Design
Web Scraping & Automation
Expert in web scraping and automation using Python libraries like Requests, BeautifulSoup, and Selenium for data extraction and process automation.
- Python Web Scraping
- Selenium Automation
- BeautifulSoup & Requests
- Data Processing & Analysis
03
Technical Skills
Technologies I work with
Languages
Python
Primary language for AI/ML, backend APIs, automation, and data pipelines
SQL
Complex queries, schema design, and optimization across PostgreSQL and MySQL
JavaScript
Frontend scripting, async patterns, and Node.js tooling
AI & LLMs
LangChain
Building agentic pipelines, RAG systems, and tool-augmented LLM applications
Hugging Face
Sentence Transformers, embeddings, and open-source model fine-tuning
TensorFlow & PyTorch
Deep learning, CNNs, LSTMs, and classical ML with Scikit-learn/XGBoost
LLM APIs
OpenAI, Anthropic Claude, Groq, Gemini: prompt engineering and fine-tuning
RAG & Multi-Agent Systems
Production RAG pipelines, vector search, and orchestrated multi-agent workflows
Backend & APIs
FastAPI
High-performance async REST APIs for AI services and data pipelines
Flask & Streamlit
Lightweight APIs and rapid AI/data app prototyping and deployment
React / Vite
Modern frontend development with fast builds and component-driven UIs
Databases & DevOps
PostgreSQL & MySQL
Relational databases: schema design, indexing, and analytical queries
ChromaDB
Vector database for embedding storage and semantic similarity search in RAG systems
Docker & Git
Containerised deployments, CI/CD pipelines, and version control workflows
04
Experience & Education
My journey so far
Agent Engineer
Lythe Labs · Singapore (Remote)
Mar 2026 – PresentBuilding production-grade AI agents and multi-agent systems at a stealth-stage AI startup. Architecting LLM pipelines, RAG systems, and autonomous agent workflows deployed across multiple domains.
AI Intern
School of AI · Georgia, USA (Remote)
Jan 2026 – Mar 2026Developed and fine-tuned LLM-based applications, contributed to curriculum content on prompt engineering and agent design, and collaborated with a global team of AI researchers and engineers.
AI Intern
AABS · Lahore, Pakistan
Nov 2025 – Jan 2026Built RAG pipelines and LLM-powered automation tools for internal business workflows. Worked with ChromaDB, LangChain, and FastAPI to deliver measurable efficiency improvements.
ML Intern
Elevvo Pathways · Cairo, Egypt (Remote)
Sep 2025Applied machine learning models to learning pathway personalisation. Implemented Scikit-learn and XGBoost pipelines for recommendation and classification tasks on educational data.
Data Analyst Intern
Excelerate · Dubai, UAE (Remote)
Aug 2025 – Sep 2025Performed data analysis and reporting using SQL and Python. Built dashboards and automated data pipelines to surface actionable insights for business stakeholders.
Data Science Intern
Securely Innovations · Islamabad, Pakistan
Sep 2024 – Nov 2024Developed ML models for cybersecurity data analysis. Built anomaly detection pipelines using Python, Pandas, and Scikit-learn to identify patterns in security event logs.
BS Artificial Intelligence
Bahria University · Pakistan
2024 – PresentStudying AI fundamentals through to advanced deep learning, NLP, computer vision, and intelligent systems design alongside real-world engineering work.
05
Featured Projects
Some of my recent work
Long-Running Autonomous Agent
Open SourceSelf-hosted AI agent capable of running autonomously for days or weeks. Uses LLM-driven planning loops, sandboxed Python execution, persistent memory, and resumable sessions via API control. Structured planning minimises hallucination rates.
Python
LangChain
LLMs
FastAPI
06
Latest Articles
Thoughts and insights on AI, development, and technology
AI & Machine Learning
What I Learned About RAG Models as an AI Intern (Real-World Lessons from a Startup)
An overview of practical lessons learned while implementing Retrieval-Augmented Generation (RAG) systems in a startup environment, highlighting how retrieval quality, data preprocessing, and system design impact the performance and reliability of LLM-based applications.
07
Certifications & Achievements
Professional certifications and course completions
IBM
Aug 20, 2025
IBM AI Developer
This comprehensive professional certificate program covers the complete journey of AI-powered software development. It includes foundational knowledge in software engineering, artificial intelligence, and generative AI, progressing through practical application development using Python, Flask, HTML, CSS, and JavaScript.
NVIDIA
Jul 15, 2025
AI Infrastructure and Operations Fundamentals
This NVIDIA course provides foundational knowledge in AI infrastructure and operations management. It covers the essential concepts, tools, and best practices for deploying, managing, and operating AI systems at scale, focusing on the technical infrastructure required to support AI workloads effectively.
Available for freelance
Hire Me on Upwork
Need an AI Engineer?
I take on freelance projects through Upwork: LLM apps, RAG pipelines, multi-agent systems, and AI integrations. Let's build something together.
Hire Me on Upwork
08
Get In Touch
Let's connect and discuss opportunities
Contact Information
I'm always interested in hearing about new projects and opportunities. Whether you have a question or just want to say hi, feel free to reach out!