Devops And Cloud Data Engineer

Description:

Your role

Support DCJ in making a real difference to vulnerable people’s lives in NSW.

Work with the latest cloud technologies (GCP/AWS) to build end-to-end green-field data products and dashboards that support executive decision-making.

Play a role in shaping the broader implementation of GCP within the Department.

What you’ll do

Working independently within a small agile project team, you will engage with business and technology stakeholders and translate user stories into technical requirements. You will be responsible for:

• Designing, developing and testing data solutions that use pipelines to integrate various data sources into common data models using cloud orchestration tools e.g., GCP Workflows, BigQuery and Python cloud functions.
• Explore building AI models and/or calling APIs to analyse unstructured text to identify topic sentiment.
• Designing, developing, and testing dashboards using Looker Studio (Google Data Studio) visualisation tool.
• Ensuring data privacy, security and integrity is maintained across all solutions and environments.
• Creating operational support documentation and assist the team in providing business-hours support as required.
• Automating wherever possible. DevOps, DataOps, MLOps to ensure security, stability and scalability of our data solutions.

What we’re looking for

• Degree in computer science, engineering or equivalent discipline or equivalent experience
• Software development / programming experience in Python
• Experience in at least one major public cloud provider (AWS, Azure, Google Cloud)
• Ability to build relationships with business representatives
• Understanding and experience explaining how system changes affect and impact on the ability to conduct business as usual while balancing user needs with user desires