Job Posting: Lead Data Engineer

Department of Health Care Access and Information

JC-539040
-
Lead Data Engineer
INFORMATION TECHNOLOGY SPECIALIST II

$8,625.00 - $11,557.00 per Month
New to State candidates will be hired into the minimum salary of the classification or minimum of alternate range when applicable.

Final Filing Date: 11/26/2026

Job Description and Duties

Under the general direction of the Data Operations Section Manager, the Information Technology Specialist II (ITS II) serves as the Lead Data Engineer within the Office of Technology Services (OTS), Infrastructure Data Operations Branch (IDOB), Data Operations Section (DOS). This role provides senior-level technical leadership across HCAI's enterprise data platforms - including the Microsoft SQL Server-based Enterprise Data Warehouse (EDW), the Databricks Lakehouse (Apache Spark / Delta Lake) environment, and the Informatica PowerCenter and Intelligent Data Management Cloud (IDMC) ingestion platforms - to enable reliable, timely, and governed data movement across HCAI's systems.

The Lead Data Engineer leads end-to-end ingestion, validation, and governance, ensuring stable data transfer to support operational processes, analytics, reporting, regulatory obligations, and cross-program integration needs. As the application-tier owner of ETL/ELT platforms, the incumbent leads design, modernization, configuration integrity, performance optimization, release 
and patch planning, permission-model management, workflow execution, and content lifecycle activities that keep data operations secure, resilient, and aligned with governance standards.

The incumbent serves as the engineering-tier owner of the Databricks environment - leading pipeline development, transformation logic, and lakehouse design - and coordinates closely with the Databricks platform administration/management function for backend and platform-tier activities, including workspace configuration, cluster and compute provisioning, platform security, and version upgrades. Similarly, the incumbent collaborates with the Infrastructure and Operations (I&O) teams and program teams to ensure underlying infrastructure, security controls, and integration requirements fully support application-tier capabilities, and advances enterprise modernization by guiding the evolution from traditional ETL toward a modern lakehouse/ELT paradigm.


For full job description, candidate must refer to the duty statement.

Take a 2-minute survey to tell us why you applied for HCAI! - https://forms.office.com/g/B6eXh2NKpZ

You will find additional information about the job in the Duty Statement.

Working Conditions

HCAI offers a hybrid telework schedule with a combination of remote and in-office work schedules for CA residents only. The telework policy is subject to change, and additional in-office days may be required and/or minimal notification may be given to report to the worksite if an urgent need arises.

 

HCAI does not provide visa sponsorship and is not an E-Verify employer.

Minimum Requirements

You will find the Minimum Requirements in the Class Specification.

Position Details

Job Code #:
JC-539040
Position #(s):
441-175-1414-012
Working Title:
Lead Data Engineer
Classification:
INFORMATION TECHNOLOGY SPECIALIST II
$8,625.00 - $11,557.00 A
New to State candidates will be hired into the minimum salary of the classification or minimum of alternate range when applicable.
# of Positions:
1
Work Location:
Sacramento County
Telework:
Hybrid
Job Type:
Permanent, Full Time

Department Information

California’s Department of Health Care Access and Information ensures healthcare access is provided to Californians where it is needed most. With offices in Sacramento and Los Angeles, we strengthen the state’s healthcare system through facility construction, expanding the health workforce, and providing health information. Our diverse team upholds the values of professionalism, innovation, equity, and service. We can provide you with the tools to start, build, or transition your career while making an impact for all Californians.


At HCAI’s Office of Technology Services, we shape conversations and generate impactful insights about California’s healthcare landscape from data submitted to us by hospitals, health plans, prescription drug manufacturers, and California’s health workforce. These conversations and insights inform policymakers, researchers, community leaders, and the broader healthcare industry regarding topics such as health care cost transparency, the total cost of care, and health outcomes. Our mission is to expand equitable access to quality, affordable health care for all Californians and we want you to join us in our cause!

 

HCAI demonstrates a commitment to building an inclusive work environment that promotes diversity, where employees are appreciated, and comfortable as their authentic selves. We value our employees’ skills, experience, and unique perspectives because they enrich our workforce and make us stronger. We embrace and support a culture providing equitable opportunities which empowers health care access and information serving diverse CA populations.

 

To learn more about HCAI, visit: http://HCAI.ca.gov/

Department Website: http://HCAI.ca.gov/

Special Requirements

Possession of Minimum Qualifications will be verified prior to interview and/or appointment. If you are meeting Minimum Qualifications with education, you must include a copy of your unofficial transcripts and/or license for verification. Official sealed transcripts will be required upon appointment. If it is determined an application does not meet the Minimum Qualifications, the applicant will be withheld from the eligibility list, rendering them inactive and ineligible to be hired for the position. Applicants who have been withheld may file an appeal with the State Personnel Board.

Application Instructions

Completed applications and all required documents must be received or postmarked by the Final Filing Date in order to be considered. Dates printed on Mobile Bar Codes, such as the Quick Response (QR) Codes available at the USPS, are not considered Postmark dates for the purpose of determining timely filing of an application.

Final Filing Date: 11/26/2026

Who May Apply

Individuals who are currently in the classification, eligible for lateral transfer, eligible for reinstatement, have list or LEAP eligibility, are in the process of obtaining list eligibility, or have SROA and/or Surplus eligibility (please attach your letter, if available). SROA and Surplus candidates are given priority; therefore, individuals with other eligibility may be considered in the event no SROA or Surplus candidates apply.

Applications will be screened and only the most qualified applicants will be selected to move forward in the selection process.
Applicants must meet the Minimum Qualifications stated in the Classification Specification(s).

How To Apply

Complete Application Packages (including your Examination/Employment Application (STD 678) and applicable or required documents) must be submitted to apply for this Job Posting. Application Packages may be submitted electronically through your CalCareer Account at www.CalCareers.ca.gov. When submitting your application in hard copy, a completed copy of the Application Package listing must be included. If you choose to not apply electronically, a hard copy application package may be submitted through an alternative method listed below:

Address for Mailing Application Packages

You may submit your application and any applicable or required documents to:

Department of Health Care Access and Information
Human Resources Office
Attn: Human Resources - Classification and Pay Unit
2020 West El Camino Avenue, Suite 1016
Sacramento, CA 95833

Address for Drop-Off Application Packages

You may drop off your application and any applicable or required documents at:

Department of Health Care Access and Information
Human Resources Office
Human Resources - Classification and Pay Unit
2020 West El Camino Avenue, Suite 1016
Sacramento, CA 95833
Drop off at 8th Floor Receptionist, Attention Human Resources
08:00 AM - 05:00 PM

Required Application Package Documents

The following items are required to be submitted with your application. Applicants who do not submit the required items timely may not be considered for this job:

  • Current version of the State Examination/Employment Application STD Form 678 (when not applying electronically), or the Electronic State Employment Application through your Applicant Account at www.CalCareers.ca.gov. All Experience and Education relating to the Minimum Qualifications listed on the Classification Specification should be included to demonstrate how you meet the Minimum Qualifications for the position.
  • Resume is required and must be included.
  • School Transcripts
  • Statement of Qualifications - A Statement of Qualifications (SOQ) must be submitted to apply for this position.
Applicants requiring reasonable accommodations for the hiring interview process must request the necessary accommodations if scheduled for a hiring interview. The request should be made at the time of contact to schedule the interview. Questions regarding reasonable accommodations may be directed to the EEO contact listed on this job posting.

Desirable Qualifications

In addition to evaluating each candidate's relative ability, as demonstrated by quality and breadth of experience, the following factors will provide the basis for competitively evaluating each candidate:
  • 5+ years of progressive IT experience in data engineering, data platform, or data management roles.
  • 3+ years of hands-on experience building and operating enterprise ETL/ELT data pipelines in a lead or senior capacity.
  • 3+ years of hands-on experience with the Microsoft SQL Server stack (SQL Server, SSIS/ETL, and enterprise data warehousing).
  • 2+ years of hands-on experience engineering data pipelines on Databricks (Apache Spark, Delta Lake, medallion/lakehouse architecture, notebooks, batch and streaming).
  • Experience administering Informatica PowerCenter and/or Informatica IDMC (workflow orchestration, configuration, upgrades).
  • 2+ years leading requirements gathering and technical design for new data pipelines or major platform enhancements.
  • Experience with data governance, lineage, cataloging (e.g., Unity Catalog), and data-quality monitoring with measurable improvements.
  • Experience with AI-ready data preparation (data quality, metadata, lineage, and feature readiness).
  • 2+ years collaborating with infrastructure, cloud, and cybersecurity peers on enterprise data platform deployments.
  • Experience mentoring, cross-training, or leading technical staff on specialized data platforms.
  • Public-sector, healthcare, or regulated-industry experience preferred.

Benefits

In addition to competitive public employee wages and a comprehensive benefits package, our employees enjoy meaningful and interesting work that supports access to healthcare.

To learn more about benefits for State employees, visit the Salary and Benefits page on the CalHR website.

HCAI is housed in a state-of-the-art building outside of downtown off Interstate-5. Enjoy a great work environment with many amenities, including FREE PARKING and fully equipped pay-per-charge electric vehicle charging stations. HCAI is close to many dining and shopping choices.

University of California (UC) and California State University (CSU) employees may qualify to transfer their current and previous employment credit to State of California employment through CalPERS. Human Resources can help with this process upon employment or you can reach out to CalPERS for inquiries at (888) 225-7377.

Contact Information

The Human Resources Contact is available to answer questions regarding the position or application process.

Department Website: http://HCAI.ca.gov/
Human Resources Contact:
HCAI Recruitment
(916) 326-3260
HRRecruitment@hcai.ca.gov

Please direct requests for Reasonable Accommodations to the interview scheduler at the time the interview is being scheduled. You may direct any additional questions regarding Reasonable Accommodations or Equal Employment Opportunity for this position(s) to the Department's EEO Office.

EEO Contact:
EEO Office
(916) 326-3261
eeo@hcai.ca.gov
California Relay Service: 1-800-735-2929 (TTY), 1-800-735-2922 (Voice) TTY is a Telecommunications Device for the Deaf, and is reachable only from phones equipped with a TTY Device.

Additional Application Requirements

You must include: 1) the classification title you are applying for, 2) "JC-Number", and 3) your source of eligibility (i.e. List Eligibility, Lateral Transfer, Reinstatement, SROA/Surplus) in the “Examination(s) or Job Title(s) for which you are applying” section of your application. Applications received without this information may be disqualified.

If you are meeting Minimum Qualifications with education, you MUST include a copy of your unofficial transcripts and/or license for verification. Example: if you are applying for a Analyst I position based on your Bachelor’s degree, you must attach a copy of your unofficial transcripts showing the conferred date of the degree you obtained. Official sealed transcripts will be required upon appointment. Applicants who fail to provide this information shall be disqualified.

Applications received via email or fax will not be accepted.

Statement of Qualifications Instructions

A Statement of Qualifications (SOQ) is required. (The SOQ is a separate document with your Name and Job Control number noted on the top, typed in Arial 12 pt font, no more than two pages.) Resumes and cover letters do not take the place of the SOQ. Applications without a clearly titled SOQ or failure to follow instructions above will not be considered for the position.
  1. Describe your hands-on experience designing, building, and operating enterprise ETL/ELT data pipelines. Include the platforms and tools you used, how you ensured reliability and performance, and the measurable improvements in data quality, throughput, or reliability you achieved.
  2. Describe your experience delivering data solutions on both a Microsoft SQL Server-based EDW and a Databricks lakehouse. Address how you designed transformations and validations on each platform, how you reconciled data between them, and the outcomes deliveredAs the lead position, this role serves as the department's data engineering subject-matter expert.
  3. Describe an example where you served as the recognized expert on a data platform - how you mentored or cross-trained team members, documented standards and procedures, coordinated with platform administration and infrastructure teams, and advised management on strategy or policy - and the impact on your team's resilience.

Equal Opportunity Employer

The State of California is an equal opportunity employer to all, regardless of age, ancestry, color, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding and related medical conditions), and sexual orientation.

It is an objective of the State of California to achieve a drug-free work place. Any applicant for state employment will be expected to behave in accordance with this objective because the use of illegal drugs is inconsistent with the law of the State, the rules governing Civil Service, and the special trust placed in public servants.

Application Methods:
Electronic (Using your CalCareer Account)
By Mail
Drop-off