Senior Data Engineer (PySpark) - Education

Truelogic is a leading provider of nearshore staff augmentation services located in New York. Our team of 500 tech talents is driving digital disruption from Latin America to the top projects in U.S. companies. Truelogic has been helping companies of all sizes to achieve their digital transformation goals.

Would you like to make innovation happen? Have you ever dreamed of building Products that impact millions of users? Nice! Then we have a seat for you on our team!

What are you going to do?

You will have the opportunity to work in a forward-thinking and growth-oriented environment at a company that is a leading provider of award-winning intelligent SaaS solutions that help organizations and individuals operate at the highest level and prepare for more challenging workplaces and environments. Providing industry-focused solutions that connect content and technology their unique product set includes employee and student training and learning management continuing education (CE) compliance training workforce scheduling safety management and more. Their extensive online and mobile learning library features curated world-class content to meet the unique needs of their clients in the industrial engineering education and public safety industries. Reaching more than 34 thousand clients and 31 million users worldwide their customers rely on them to help them prepare for the changes that come with new technologies complex compliance regulations and more challenging workplaces and environments.

Occupy a unique position in the market helping higher education institutions take on the issues that matter most. Whether it’s sexual assault and harassment alcohol and substance misuse wellness and mental health or diversity and inclusion the CPN provides tools resources and insights to support their partners in driving lasting large-scale change. Learn more about how 2200+ higher education institutions and organizations are leveraging the Vector Campus Prevention Network to advance their safety well-being and inclusion initiatives and elevate their impact on student and institutional success.

• Building Data pipeline data modeling and familiarity with data architecture.

• ML related programming.

• BI reporting and dashboards.

• Mapping from existing platforms to canonical models and piping the models to Datawarehouse.

What will help you succeed

• Deep knowledge and experience with Spark.

• Candidates must have critical and analytical thinking and must be able to justify their actions and decisions.

• All the candidates must specifically have AWS Glue Pyspark development experience. Just having Python isn't sufficient.

• Should have AWS pipeline/warehouse experience.

• Should have experience in Python programming.

• Should be aware of data processing architecture like Lambda.

• Amazon S3.

• Strong Python experience.

• SQL expertise with PostgreSQL MySQL or equivalent.