Job Description
As a purpose-led, performance-driven organisation, Blackmores Group strives to create remarkable employee experiences through supporting a diverse and inclusive culture, creating leadership that inspires high performance, and providing everyone with opportunities to achieve their professional, personal and wellbeing goals supported by our flexible work practices and family friendly policies.
Blackmores Group operates in 11 markets, with headquarters in Sydney, an international state-of-the-art manufacturing facility in Braeside, Victoria and additional offices in South East Asia and China.
Purpose of role:
The Senior Data Engineer will play a key role in enabling Blackmores Group's AI initiatives. This position focuses on scoping, designing, and implementing data pipelines and integration programs that support AI-driven decision-making and operational processes. The role requires a strong background in data engineering, ETL processes, and both batch and real-time data processing, preferably within a Google Cloud environment. This is an exciting new green field role to help shape the future of Health science for the Vitamins category.
Responsibilities include:
1. Design and Develop Data Pipelines: Develop and maintain scalable ETL and ELT processes to support both batch and real-time data requirements.
2. Integration Programs: Scope, design, and implement integration workflows to seamlessly connect different data sources, ensuring effective flow of information across the Blackmores Group.
3. Collaborate Across Teams: Work within a matrix environment and collaborate with the Data Centre of Excellence and other established teams across the organization to deliver data solutions that meet business needs.
4. Prototype Data Solutions: Use MVP and prototyping philosophies to explore different technical solutions for integrating source data and determining the best data consumption models.
5. Data Management and Optimization: Handle unstructured datasets and design document database architectures, while working to improve data quality and reliability.
Who are you?
- 5+ years of experience in data integration and pipeline development in project environments.
- 3+ years of experience establishing and implementing ML Ops workflows and models, preferably in Google Cloud. CI/CD/CT experience is highly valued.
- 3+ years of experience working with data for machine learning purposes, including training, evaluating, and deploying models to production.
- 5+ years of experience with SQL and proficiency in Snowflake.
- Strong knowledge of ETL processes, data engineering best practices, and real-time data streaming.
- Experience with unstructured data and document database architectures.
- Experience working with Google Vertex AI environments.
- Experience working in Agile delivery environments.
- Familiarity with a range of data formats and sources, such as APIs, Email, SharePoint, Excel, XML, JSON, Parquet, and event-driven architectures.
- Experience with data orchestration tools, such as Airflow, Coalesce, Azure Data Factory, or Azure Logic Apps.
- Experience with CI/CD practices, ideally using Azure DevOps or GitHub Enterprise.
What we offer:
- Great benefits to support your health and wellbeing, including access to free and discounted products and additional leave for your wellbeing.
- Profit share, we all work together to make profit so we all get a share!
- Mental health support for you and your family through our Sonder assistance program.
- Opportunities to support your local community through paid community leave.
Agencies please note: this recruitment assignment is being managed directly by Blackmores Talent Acquisition team. We will reach out to our preferred agency partners if required. Your respect for this process is appreciated.