Senior Data Engineer (Information Technology Specialist III)

Job Description and Duties California’s long-awaited statewide Cradle-to-Career Data System has launched. You can help build a statewide system that brings together existing data with an aim of addressing barriers to opportunity from early learning, through K-12, college, and career. We are hiring a Senior Data Engineer (SDE) to lead the development of data pipelines to ingest, cleanse, transform, and integrate into the Cradle-to-Career Data System. The incumbent will ensure data is available as a service for data warehouses, digital services, and dashboards. The SDE will plan, develop, and document policies and best practices for the Office of Cradle-to-Career Data. We are looking for an engineer who is excited to build something new with a small, entrepreneurial team, using emerging technologies. About the Role As the Senior Data Engineer, you will have responsibility for data lifecycle management, end-to-end. This includes: • Data Management. Plan, design, develop, and implement processes for data management and ensuring that data are secure at rest, in transit, and in use. • Data Quality. Design, develop, and document patterns and practices to help ensure all data is profiled, reviewed, and accurate to support critical decisions using industry best practices for continuous integration and continuous delivery. • Collaborate. Work with colleagues and contractors to build and guide architectural improvements to data infrastructure while simultaneously supporting team members to evolve continuous integration and continuous delivery strategy with robust monitoring, altering and recovery. Your work will be challenging, fun, and focused on enabling Californians to build a more equitable future. You will find additional information about the job in the Duty Statement. Special Requirements • The position(s) require(s) a Background Investigation be cleared prior to being hired. Desirable Qualifications In addition to evaluating each candidate's relative ability, as demonstrated by quality and breadth of experience, the following factors will provide the basis for competitively evaluating each candidate: The ideal candidate would have the following knowledge, skills, and abilities. • You have 5 or more years of experience with each of the following technologies: AWS, Snowflake, and dbt. • You have 5 or more years of experience with automating, orchestrating, and maintaining data engineering pipelines end-to-end which includes, but is not limited to, the following: ingestion, validation, quality, transformation, and integration. • You have 5 or more years of experience protecting and securing sensitive data in accordance with state and federal laws, regulations, and standards which includes, but is not limited to, the following: FIPS, NIST, FERPA, HIPAA, HEA, and the Privacy Act. • You love engaging with people as much as engaging with data and technology • You are constantly learning and engaged in the modern data stack ecosystem and enjoy staying up to date on emerging and best practices. • You have a knack for and enjoy communicating technical and architectural tradeoffs clearly to different audiences. • You value simplicity and elegance in architecting solutions over needless complexity and have a sixth sense for evaluating platforms that are fit for purpose. • You like keeping knowledge fresh on platforms and willing to get in and support the team on testing and implementing platforms. • You value good documentation and guidance to help others successfully use data platforms. • You take pleasure in sharing your knowledge and experience with others to help them succeed in adopting modern data practices. • You relish demonstrating the value of a cloud-first approach to data tools and the benefits of applying software engineering approaches to data work and are eager to hands-on engage with project work to ensure that value is communicated. • You are excited about applying your talents to improve the lives of Californians.