Certification Exam developer

As a Certification Exam Developer at Databricks, you will apply your experience and expertise in exam design, development, and maintenance for the Databricks Certification Program. In this role, you will work for the Manager of Certification Development to design, develop, analyze, and maintain Databricks accreditation and certification exams in areas of data engineering, data analysis, machine learning, and cloud architecture and systems integration.

As a member of the Certification Development team, you’ll work closely with global stakeholders, technical subject-matter-experts, and technical curriculum developers to deliver certification content that meets the needs of Databricks partners, customers, and the entire Data + AI industry.

Outcomes

• Own and maintain assessments for high-stakes, proctored certification exams and low-stakes, unproctored accreditation assessments in accordance with industry standards and psychometric principles.
• Develop test items working closely with SMEs. 
• Recruit, train and schedule SMEs in writing technically and psychometrically sound test items.
• Monitor assessment and exam performance on an on-going basis to ensure they meet the target roles/ competencies and program requirements.
• Ensure currency and quality of test items based on frequent product and platform changes.
• Assist in creating certification enablement materials including exam guides, sample tests, guided exam prep journeys, and prep courses.
• Utilize item development and delivery platforms for exam operations and delivery
• Function as a company-wide subject-matter-expert on assessment principles and best practices, along with educating Bricksters on said principles and best practices
• Provide answers and support to the Support Team and/or respond to escalated support issues related to our exams in a timely manner.
• Stay up to date with the latest Databricks feature releases

Skills/Experience

• Able to learn new technologies quickly
• Analytical skills and data-driven decision making
• Stakeholder management and interpersonal skills
• Experience in developing technical assessments based on industry standards for low-stakes assessments (lead job task analysis, conduct item development workshops, lead technical review of written items, Standard setting)
• Experience developing and maintaining professional certification exams based on industry standards for high-stakes assessments (lead job task analysis, conduct item development workshops, lead technical review of written items, Standard setting)
• Familiar with psychometric principles and know how to use data to analyze item exposure and overall exam health
• [Preferred] Experience with topics related to big data analytics such as Spark, data science, machine learning, and cloud
• [Preferred] Experience with software development, especially in one or more of these languages: Python, SQL