Senior Data Engineer.(6+ Years of Exp)

At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

Minimum Qualifications

• Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
• Advanced SQL skills and experience with relational databases and database design.
• Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
• Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
• Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
• Proficiencient in data pipeline and workflow management tools e.g. Airflow
• Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
• Experience with the AWS/Azure/GCP data engineering services
• Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
• OR
• Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
• Very good exposure of working on Data Lakes & Data Warehouses solutions
• Excellent problem-solving, communication, and organizational skills.
• Proven ability to work independently and with a team.
• Ability to guide other data engineers.