Senior Data Engineer

About us Velvetechis an American global software development company headquartered in Miami, FL, and with an office in Chicago, IL. Velvetech has its developers strategically distributed in 10+ global technical job markets to deliver the best in class software engineering and exceptional client services. We have 20+ years of experience in software and hardware development for clients all around the world, especially for US clients. As an official Microsoft Gold Partner, our company is listed in the top 5 software development companies in Illinois, USA. US clientsare leading trading and financial organizations, insurance companies, large healthcare associations, pharmaceutical and energy companies, equipment manufacturers, hi-tech startups, etc. Areas of expertiseare consulting, development, implementation, and support of software solutions. We implement modern backend solutions that support microservices architecture with the following technologies: NET Core, Node.js, Java, SQL Server, PostgreSQL, MongoDB, Redis, RabbitMQ. For the web UI front-end development, we opt for React, or Angular, and for mobile development — Swift, Kotlin, Java. Most of the systems are designed for cloud infrastructures like AWS, Azure, GCP, and heavily rely on Docker, Kubernetes while modern CI/CD is made using GitLab CI or TeamCity. In September 2021, Velvetech LLC received the status of the official Training Provider of the International Institute of Business Analysis. This status gives us the right to conduct regular quality trainings for Business Analysts and anyone performing BA activities regardless their job title. Principlesare based on Agile Methodology, Scrum and Kanban. Various projects coded in GitLab or GitHub are built with multiple coordinated teams, collaborating via Jira, Confluence, MS Teams, and Slack. Velvetech constantly follows the Tech trends and actively cooperates with startups in such breakthrough areas as Machine Learning, the Internet of Things, Blockchain, FPGA, and AI.Position overview We are looking for a Senior Data Engineer with deep expertise in Python and SQL. You will design, implement, and optimize data pipelines and ETL processes, ensuring high performance, scalability, and reliability. This is a fully remote position with flexible working conditions.Responsibilities • Develop and optimizeETL workflows using Python and SQL. • Design and implementscalable data pipelinesfor processing various data sources. • Work withrelational databases(e.g., PostgreSQL, Oracle) to ensure efficient data storage and retrieval. • Optimize SQL queries and Python scripts for performance and maintainability. • Implement robusterror handling, logging, and monitoringfor data processing pipelines. • Collaborate with cross-functional teams to integrate and manage data sources.Requirements • 5+ years of experience in Data Engineering. • Expert-level Python and SQL skills– ability to write efficient, scalable, and maintainable code. • Strong experience in designing ETL processes and working with large datasets. • Solid understanding of database performance tuning and query optimization. • Experience with data modeling and schema design. • Familiarity with cloud storage solutions (Azure, AWS, or GCP). • Strong problem-solving skills and ability to work independently. • Nice to have: Experience with PySpark, orchestrators and knowledge of CI/CD for deployment process automation.Benefits • Velvetech is in theTOP 5development companies in Illinois,USA • You haveFLEXIBLEworking conditions and aCOOPERATIVEenvironment • Competitive salary • ManyCHALLENGINGand exciting projects with new opportunities and learning • GROWTHopportunities, skills and competencies improvement, and professional certification • In-companyTRAINING(English, Software / DevOps / Project management / Design / Business)Our team We are a friendly team of 150+ professionals where everyone is able to achieve high results and grows professionally not only due to their own knowledge and skills but also with the support of colleagues. Values that we highly appreciate arehigh performance, responsibility, respect, and loyalty. In order to have a highly motivated team, Velvetech invests in their people, additional education, certification, and others.You choose your career path and we are here to support you! People work together in harmony, encouraging each other to continuously learn, progress, and pursue perfection. Our employees enjoy working as we turn challenges into advantages to share success with each other. You have a chance to become a part of a friendly and professional team that creates robust software solutions to deliver maximum value to our international clients!