# Kashif Sohail

> Senior Data Platform Engineer (contract / B2B) building cloud data platforms and production LLM pipelines on GCP and AWS. Remote, with strong overlap with European and US East Coast hours. Contracts corp-to-corp through KashEdge LLC (US).

- Website: https://kashifsohail.com/
- Email: me@kashifsohail.com
- LinkedIn: https://www.linkedin.com/in/kshfse/
- GitHub: https://github.com/kashif-se
- Company: https://kashedge.net
- Full profile (Markdown): https://kashifsohail.com/llms-full.txt

## Working with me

- Remote B2B contracts, corp-to-corp through KashEdge LLC (US); strong overlap with EU and US East Coast hours
- Honest scoping: I agree clear boundaries and an estimate before committing
- Prefers fixed-price, milestone-based engagements
- Boutique studio model: I own architecture and the client relationship; a small team helps with delivery

## Expertise

- Data platforms on GCP (BigQuery, Cloud Composer, GKE, Pub/Sub), AWS (MWAA, Lambda, ECS, Bedrock, Redshift) and Azure
- Warehousing and lakehouse: Snowflake, BigQuery, ClickHouse, Databricks / Delta Lake, Apache Iceberg
- Orchestration and transformation: Airflow, Dagster, dbt, Meltano / Singer, dlt
- Streaming and CDC: Kafka, Spark Streaming, Pub/Sub, RabbitMQ, log-based PostgreSQL CDC
- Production LLM systems: multi-model ensembles, RAG, LangChain / LangGraph agents
- Infrastructure as code and CI/CD: Terraform, Kubernetes, GitHub Actions, Workload Identity Federation

## Selected work

- LLM supplier entity-matching platform: built on AWS (Bedrock, MWAA, Fargate, Redshift), then rebuilt on GCP (GKE, Cloud Composer, Snowflake) with a Gemini / Claude / GPT consensus ensemble
- Production GCP data platform for a music streaming company, with ClickHouse serving sub-second Creator Studio analytics
- Social media ingestion and normalisation platform on Databricks / Delta Lake for a media-intelligence company
- Snowflake platform with Dagster on AKS and log-based CDC for a US delivery-tech company
- Careem (Uber): AWS data platform and self-serve portal running 500+ streaming and 700+ batch jobs
- DataOps agent (LangGraph) that remediates Dagster pipeline failures and PostgreSQL replication-slot bloat automatically
- Legal AI search engine (LangChain, Pinecone, FastAPI) running on AWS

## Open source

- tap-absorb: Singer tap for Absorb LMS — https://github.com/kashif-se/tap-absorb
- tap-nuvemshop: Singer tap for the Nuvemshop / Tiendanube API
- target-bigquery: partition-column and table-name mapping extensions — https://github.com/kashif-se/target-bigquery
- airflow-google-chat-integration: Airflow task alerts to Google Chat — https://github.com/kashif-se/airflow-google-chat-integration
- docker-windows-python-oracle-instant-client — https://github.com/kashif-se/docker-windows-python-oracle-instant-client
- docker-ipyjulia-notebooks — https://github.com/kashif-se/docker-ipyjulia-notebooks
- In progress: tap-workday (Singer SDK, RaaS + REST/WQL) and a Meltano self-service platform UI on Dagster

## Products

- WakeelsApp: AI case-management app for lawyers in Pakistan (Flutter, Flask, PostgreSQL) — https://wakeels.app
- Altasreef: Arabic morphology learning app (Flutter, FastAPI) — https://play.google.com/store/apps/details?id=org.haqnawaz.altasreef

## Experience

- Principal Data Platform Engineer, independent consultant (2022 – present)
- Data Engineer II, Careem (2021 – 2022)
- Data Engineer, Easypaisa / Telenor Microfinance Bank (2019 – 2021)
- Big Data Engineer, SlashNext (2018 – 2019)
- Software Engineer, Expertflow (2016 – 2018)

## Community

- Founder of Sahiwal Tech Community (1,450+ members); organised AWS Student Community Day Sahiwal 2026 (500+ attendees), where he gave the talk "Data Platforms Decoded" (write-up: https://builder.aws.com/content/3KaigkKAZjtEp3kB901sChqXfgb/data-platforms-decoded-five-jobs-two-real-aws-builds-and-500-builders-in-sahiwal) and Dev Days Sahiwal 2026 with GitHub
- Talks: "Building a Strong Foundation Before Chasing AI" at Notion Elevate, CUI Sahiwal (Feb 2026), "Your First Step Into Data Platforms" at Google DevFest Sahiwal (2024), A Road Map to Success at CUI Sahiwal (2024, 250+ students), Open Source Day panel (2022), Applied Data Science at Riphah International University (2019), a "Data Science for Everyone" series at Quaid-i-Azam University, Arid Agriculture University, Air University and CUI Sahiwal, and DPSC Sahiwal (2026)
- Mentors graduates into roles at companies including Expertflow, Arbisoft, Constellation Software, SABIC, AddoAI and Mountainise
- COMSATS University Islamabad Alumni Excellence Award — Social Impact & Community Service
- Industrial Advisory Board member, Department of Computer Science, COMSATS University Islamabad (Sahiwal)

## Education

- MS Data Science, Information Technology University, Lahore (2017 – 2019)
- MicroMasters in Data Science, UC San Diego / edX (2017 – 2018)
- BS Computer Science, COMSATS University Islamabad, Sahiwal (2012 – 2016), Campus Bronze Medalist

## Certifications

- Microsoft Certified: Azure Fundamentals (2021)
- Certified Data Domain Practitioner, Ant Financial (2020)
- Big Data Analytics Using Spark, UC San Diego / edX (2018)