Data Engineer | Brazil, remote

Data Engineer | Python, FastAPI and Redis experience

Location: BR/LatAm, Remote
Position type: Full-time Contract, 3+ months with the possibility to extend.
Position Summary
Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and beyond. Our expertise lies in delivering tailored solutions in Business Intelligence, Data Warehousing, and Project Management. We have a diverse, global team of consultants, all working remotely, embodying a collaborative, inclusive, and innovation-driven work culture.
Job Summary:
We are seeking a skilled and detail-oriented Data Engineer to join our dynamic team. The primary responsibility of this role will be to develop and maintain APIs using Python's FastAPI framework. These APIs will interact with Snowflake to retrieve data, and in some cases, process data in Databricks. The ideal candidate will have a strong background in data engineering, API development, and experience working with cloud-based data platforms.
Key Responsibilities:

• API Development: Design, develop, and maintain robust, scalable, and high-performance APIs using Python's FastAPI framework.
• Develop APIs that leverage company data and utilize Redis for storing calculations.
• Data Retrieval: Implement solutions to efficiently retrieve data from Snowflake, ensuring data integrity and security.
• Data Processing: Collaborate with data scientists and analysts to process and prepare data using Databricks when necessary.
• Integration: Integrate APIs with existing data systems and platforms, ensuring seamless data flow and interoperability.
• Optimization: Continuously optimize the performance of APIs and data retrieval processes to ensure minimal latency and maximum efficiency.
• Collaboration: Work closely with cross-functional teams including Data Scientists, Data Analysts, and Software Engineers to understand data needs and deliver high-quality solutions.
• Documentation: Maintain comprehensive documentation for all developed APIs and data processes.
• Testing: Implement thorough testing procedures to ensure the reliability and accuracy of the APIs and data processing workflows.
• Monitoring: Monitor the performance of APIs and data pipelines, troubleshoot any issues, and implement timely fixes.

Experience:

• Proven experience as a Data Engineer or similar role.
• Strong experience in developing APIs using Python, preferably with the FastAPI framework.
• Strong experience working with Redis.
• Experience with Snowflake for data retrieval and management.
• Familiarity with Databricks for data processing.
• Experience in cloud environments (AWS, Azure, or GCP).

Skills:

• Proficiency in Python and FastAPI.
• Strong understanding of SQL and data warehousing concepts.
• Familiarity with ETL processes and tools.
• Knowledge of CI/CD pipelines for API deployment.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills, with the ability to work collaboratively in a team environment.

Preferred Qualifications:

• Experience with containerization technologies such as Docker.
• Familiarity with other API frameworks and data engineering tools.
• Experience with version control systems like Git.
• Knowledge of data security best practices.