Principal Engineer - Data Engineering
Company
AiDash
Location
South Bay
Type
Full Time
Job Description
Who is AiDash?
AiDash is making critical infrastructure industries climate-resilient and sustainable with satellites and AI. Using our full-stack SaaS solutions, customers in electric, gas, and water utilities, transportation, and construction are transforming asset inspection and maintenance - and complying with biodiversity net gain mandates and carbon capture goals. Our customers deliver ROI in their first year of deployment with reduced costs, improved reliability, and achieved sustainability goals. Learn more at www.aidash.com.
What you will do?
- Architect and implement scalable data processing platform for managing large-scale, heterogeneous geospatial data, including satellite imagery, LiDAR data, weather information, and enterprise datasets. Ensure these systems can efficiently ingest, store, and process diverse data types to support various analytical and operational needs.
- Implement rigorous data quality control measures and standardisation processes to maintain the integrity and accuracy of datasets. Develop protocols for data validation, cleaning, and deduplication, ensuring high-quality data is available for critical decision-making processes.
- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and implement systems that enable data-driven decision-making.
- Stay abreast of industry trends and innovations in data engineering and propose the adoption of new technologies, tools, and methodologies to improve our data systems.
- Evolve AiDash architecture as we continue to scale. · Lead large initiatives across teams (refactor service to improve code quality, runtime efficiency, resource optimisation, keep stack updated, propose new technologies etc)Be in-house expert and provide consultation to product engineers to help them build scalable and reliable systems.
- Provide technical direction and leadership to drive large initiatives and execute key org goals.
What are we looking for?
- Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field.
- Minimum of 12+ years of experience in data engineering with a proven track record of designing and operating large-scale data systems.
- Experience building and maintaining modern data pipelines in the cloud or hybrid.
- Strong experience with big data technologies (e.g., Hadoop, Spark), database systems (e.g., SQL, NoSQL), and ETL tools.
- Strong hands-on expertise with at least one programming language: Scala, Java, or Python.
- Deep understanding of data modelling, data warehousing solutions, and data architecture strategies for both transactional and analytical systems.
- Experience with cloud services (AWS, Azure, Google Cloud) and understanding of data pipeline tools and services offered by these platforms.
- Excellent problem-solving, analytical, communication & teamwork skills.
- Leadership experience and the ability to work cross-functionally with other teams to achieve company goals.
What other experience will make you a great candidate?
- Experience in building platform on geospatial data management and processing.
- Hands on experience in writing, designing image processing system, complex operations on geo data.
Date Posted
03/16/2024
Views
18
Similar Jobs
Senior Developer, Data Engineer - Tarana Wireless, Inc.
Views in the last 30 days - 0
Tarana is seeking a Senior DeveloperData Engineer with 5 years of experience in building largescale data pipelines The role involves designing buildin...
View DetailsStaff Engineer, System Design Verification Engineering - Western Digital
Views in the last 30 days - 0
Western Digital is seeking a validation engineer to define and track test plans characterize and optimize SSDs and lead bug review meetings The ideal ...
View DetailsPrincipal Software Engineer (Prisma Access) - Palo Alto Networks
Views in the last 30 days - 0
Palo Alto Networks is a cybersecurity company committed to protecting the digital way of life They are seeking a Principal Software Engineer to build ...
View DetailsPrincipal Engineer Software (Full Stack Developer) - Palo Alto Networks
Views in the last 30 days - 0
Palo Alto Networks is seeking a Senior FullStack Engineer to develop and maintain highperformance web applications collaborating with crossfunctional ...
View DetailsStaff Flight Test Engineer - Wisk
Views in the last 30 days - 0
Wisk Aero is seeking a Staff Flight Test Engineer to join their team in Hollister CA The role involves ensuring safe and efficient flight testing and ...
View DetailsTechnologist, System Design Engineering - Western Digital
Views in the last 30 days - 0
Western Digital is seeking a Technologist with expertise in SSD design hardware design Product Management Memory Systems and system architecture to le...
View Details