March 2010 - December 2024 (14 years and 9 months)
Bengaluru, Karnataka, India
• Spearheaded data architecture for Algonomy's flagship retail analytics products and CDP.
• Reduced infra cost by 25% by designing and implementing a cloud-based Data Lakehouse architecture for CDP.
• Led the evaluation and adoption of various cloud databases and data services like AWS Redshift, AWS Athena, AWS Aurora, AWS Kinesis, AWS EMR, etc
• Designed streaming data ingestion pipelines using Kinesis Data Streams and Kinesis Firehose.
• Designed a Spark based application to organize and curate files in data lake to make it ready for analytics using SQL. This application automates various data quality checks, data standardization and conversion of files to parquet format.
• Handled various responsibilities including Data Modelling, Solution Design and Delivery, Pre-delivery Workshops, Pre sales Support, etc.
• Travelled to multiple customer locations in North America and Southeast Asia to conduct business and technical workshops.
• Led a team of 15+ data engineers as the Head of Solution Engineering