Psychometrician

Instructure · USA

Company

Instructure

Location

USA

Type

Full Time

Job Description

At Instructure, we believe in the power of people to grow and succeed throughout their lives. Our goal is to amplify that power by creating intuitive products that simplify learning and personal development, facilitate meaningful relationships, and inspire people to go further in their educations and careers. We do this by giving smart, creative, passionate people opportunities to create awesome.

We are seeking a highly skilled, motivated, and passionate Psychometrician to join our innovative assessment team. The successful candidate will play a crucial role in the development, analysis, and validation of educational assessments ranging from formative to predictive in nature. As a Psychometrician, you will ensure our assessments are high-quality, fair, reliable, and valid, contributing to the advancement of educational measurement and research.


What you will be doing
  • Data Analysis and Validation:
  • Conduct statistical analyses to evaluate the reliability, validity, and fairness of assessments (maintain item pValues, field testing items, etc.)
  • Perform item analysis, differential item functioning (DIF) analysis, and other psychometric evaluations.
  • Evaluate criterion, proficiency predictive validity evidence and provide actionable insights for internal stakeholders to ensure student performance on assessments predicts performance and proficiency levels on high-stakes assessments.
  • Evaluate consequential validity evidence to provide insights to internal and external stakeholders.
  • Evaluate p validity evidence and provide actionable insights for internal stakeholders to ensure student performance on assessments predicts performance on high-stakes assessments.
  • Analyze test data to generate reports and provide actionable insights for internal and external stakeholders.

  • Research and Methodology:
  • Conduct validity studies in partnership with the Research team for specific districts/institutions and markets.
  • Stay current on advancements in psychometric methods and educational measurement as well as state assessment requirements, suggesting new and revised assessment methodologies.
  • Partner with Research and Products to contribute to scholarly publications and/or conference proposals.
  • Partner with product managers and team to inform assessment strategy

  • Technical Documentation:
  • Prepare technical reports and documentation detailing psychometric analyses, methodologies, and findings.
  • Ensure clear communication of complex statistical concepts to non-technical audiences.

  • Quality Assurance:
  • Participate in quality assurance processes to ensure the accuracy and integrity of assessment data and results.
  • Collaborate with software developers to implement and refine automated scoring and analysis systems.

  • Training and Support:
  • Provide training and support to internal teams and external partners on psychometric principles and best practices.
  • Assist in the development of training materials and resources.


  • What you will need to know/have
  • A doctoral degree (Ph.D. or Ed.D.) in Psychometrics, Educational Measurement, Quantitative Psychology, or a related field.
  • At least 3 years of experience in psychometrics, educational measurement, or a related field, preferably within an educational assessment company or academic setting.
  • Experience with item response theory (IRT), classical test theory (CTT), and other psychometric models.
  • Proficiency in statistical software and programming languages (e.g., Python, R, Stata).
  • Strong analytical, problem-solving, critical thinking, time management and organizational skills.
  • Excellent written and verbal communication skills.
  • Ability to work collaboratively in a team-oriented environment.
  • Ability to translate complex technical and psychometrics research and statistical information into team-facing and user-facing results, actionable plans, and recommendations.
  • A passion for education and a drive to improve assessment materials and experiences for educators and learners


  • Get in on all the awesome at Instructure!
  • Competitive salary, equity and 401k.
  • Medical, dental, disability, and life insurance.
  • HSA program, vision, voluntary life, and AD&D.
  • Tuition reimbursement.
  • Paid time off, 11 paid holidays, and flexible work schedules.
  • LifeStyle Spending Account
  • We’ve always believed in hiring the most awesome people and treating them right. We know that the more diverse we are, the more diverse our ideas will be and when we openly welcome those ideas, our environment is better and our business is stronger.

    At Instructure we participate in E-Verify and yes, in case you didn't catch it from the above, we are an Equal Opportunity Employer.

    All Instructure employees are required to successfully pass a background check upon being hired.
    Apply Now

    Date Posted

    06/10/2024

    Views

    0

    Back to Job Listings Add To Job List Company Profile View Company Reviews
    Positive
    Subjectivity Score: 0.9

    Similar Jobs

    Engineering Manager - Software Supply Chain Security: Auth Infrastructure - GitLab

    Views in the last 30 days - 0

    This job description highlights a leadership role in developing secure scalable authentication infrastructure for GitLab It emphasizes technical exper...

    View Details

    Staff Salesforce Engineer - CRM Systems - GitLab

    Views in the last 30 days - 0

    This job description outlines a Staff Salesforce Developer role focusing on designing building and scaling enterprisegrade solutions across Salesforce...

    View Details

    Growth Product Lead - Loyalty - Trafilea

    Views in the last 30 days - 0

    Trafilea promotes itself as a transformative consumer tech platform with AIdriven growth solutions highlighting achievements like 1B revenue and globa...

    View Details

    Sales Prospecting Account Executive - Financial Solutions - Blackbaud

    Views in the last 30 days - 0

    This job posting seeks Prospect Account Executives to sell Financial Management applications for nonprofits and governments Responsibilities include s...

    View Details

    Solutions Architect - phData

    Views in the last 30 days - 0

    This job posting seeks a Solutions Architect to join phDatas Elastic Platform Operations team focusing on cloudnative data platforms like Snowflake AW...

    View Details

    Team Lead - Publisher Success Management (AdTech) - MGID

    Views in the last 30 days - 0

    MGID is a fastgrowing digital advertising company seeking a resultsdriven Team Lead to oversee client relationships and drive business growth in the U...

    View Details