Senior Data Engineer Position Available In Colbert, Alabama
Tallo's Job Summary: The Senior Data Engineer position at the Home Office's Data Services and Analytics (DSA) team involves developing complex data pipelines, transforming data from various sources, and working with AWS tools like S3, Athena, Redshift, Glue, and languages like Python and Java. Responsibilities include building data models, resolving pipeline issues, testing solutions, improving processes, and communicating with stakeholders. The role requires a minimum of 60% office attendance and is not suitable for part-time work.
Job Description
The Digital Data and Technology (DDaT) profession enable the Home Office to keep the UK safe and secure. They do this by designing, building, and running the services that help people apply for visas or passports, support policing and counter-terrorism operations, and protect the UK’s borders. Data Services and Analytics (DSA) is the part of DDaT which leads the build of data products to integrate data from multiple sources, and then deliver products for business intelligence, reporting and data science. DSA has the ambition to be one of the leading providers of insight services in UK Government and is currently growing significantly with over 300 colleagues, providing services to variety of functions within the Home Office. In this role, you will identify and deliver new data sources and develop ETL processes, collaborate with the Data Acquisition, Analytics and Infrastructure teams to deliver the data strategy through the design and implementation of technology systems. We value diversity and provide an open, inclusive, and supportive environment to help you do your best work. The successful candidate will either be located in: 2 Ruskin Square
- Croydon, 3 Northgate
- Glasgow, The Capital
- Liverpool, Soapworks
- Manchester or Vulcan House regional office Sheffield.
Under Home Office hybrid working practices there is an expectation that you will attend the office for a minimum of 60% of your working hours . Therefore, this role is not suitable for part-time working due to the nature of the role. The Senior Data Engineer positions in the Data Services and Analytics (DSA) team require support development of complex data pipelines, ingesting and transforming data from/to a variety of sources (email, csv, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet). Data pipelines are primarily developed in AWS using a variety of tools and languages including
AWS S3, AWS
Athena, AWS Redshift, AWS Glue, python and java (Docker / Spring).
Tasks and responsibilities will include:
Developing new data models working collaboratively with the analytics team and mapping data to an appropriate target data model. Identifying issues in data pipelines and managing their resolution. Designing, building and testing data integration solutions that are complex or large scale, through full development, test and deployment lifecycles. Continually improving processes and efficiency in the acquisition and ingestion of data. Engaging with customers and business analysts to define new features and communicating progress. Ensuring the successful and timely delivery of data to customers, Data Analysts and Data Scientists.
