Yashas J Shamaraju
Yashas J Shamaraju
Data engineer.
Systems builder.
Now building for AI.
8+ years architecting scalable cloud data platforms and distributed systems across AWS, Spark, Databricks, Snowflake, and Redshift — currently extending that foundation into RAG, agentic AI, and AI-powered data systems.
...across the Data Stack
Technical Mastery
My experience spans the full lifecycle of modern data systems—from ingestion and distributed processing to data modeling, reliability, cloud architecture, and increasingly AI-powered applications.
What interests me most is not a particular tool, but understanding how systems behave at scale, where they fail, and how better architecture can make them faster, more reliable, and easier to operate.
Python, SQL, Spark, PySpark, AWS, Microsoft Azure, Databricks, Snowflake, Redshift, dbt, Airflow, Kafka, Terraform, Glue, EMR, S3, Lambda, Talend, Kedro, TensorFlow, RAG, LLMs, Agentic AI
GitHub Projects
Featured Projects
Enterprise Data Platform
End-to-end data pipeline architecture using AWS and Databricks for real-time processing.
RAG AI Implementation
Developing custom retrieval-augmented generation systems for proprietary data sets.
Distributed Systems Lab
Researching performance bottlenecks in large-scale Apache Spark clusters.
Let's Connect
Always up for a good conversation about data, AI, or your next big pipeline problem.