This month, with the support of AWS, Heroes from across Australia and New Zealand hosted a special week-long community event. Community events like this are a great place to learn, get inspired, and expand your network.
We showcased and celebrated local community speakers who are innovating in the world of Data, Alexa & Connect, IoT, Machine Learning, and Video & AR.
In this post, I’ll be sharing the inspiring talks that were presented on Data Day. Check out the videos for more!
Using Route 53 as a database
Our first talk of the day was from Corey Quinn, Cloud Economist at The Duckbill Group. In this talk, you’ll hear how to misuse various AWS services as databases. He guarantees this will drive AWS Solutions Architects, who know what they’re doing into the realms of madness.
Nearmap AI: the story of data curation to power deep learning
Next, we heard from Suneeta Mall, Principal Machine Learning Engineer at Nearmap. Suneeta and her team focus on utilising AWS services to build systems that curate ground truth. This talk also tackles how Nearmap grows and scales this dataset while managing the challenges around efficiency and quality.
In the next talk, Terence White from Land Information NZ continued the GIS and mapping theme. Terence showed us how Land Information NZ takes terabytes of raw aerial images and processes them to generate maps at a fraction of the traditional cost.
Lambda v Glue: serverless ETL and machine learning
Jeremy Nagel then talked us through how GOFAR uses Lambda to ingest telematics data, XGBoost powered machine learning jobs and compact parquet files for their Athena backed warehouse.
Building a lightweight serverless data pipeline using AWS Fargate
Amey Khedekar and Owen Yan from Carsales.com.au shared their experience in creating a lightweight data pipeline. The benefits of their approach are serverless execution and flexible architecture using AWS Fargate with ECS and Apache Airflow.
Introduction to real-time data analytics through Amazon Kinesis
Olivia Carline from the AWS Solutions Architect team showed how to create your own real-time data analytics solution with Kinesis. Starting with common use cases, design patterns, and finishing with how to ingest and get insights from your data.
Building a serverless event-driven lake house
To finish the day, Marat Levit from Servian walked us through a solution that utilises common, and sometimes underrated, services. The result was a serverless event-driven lake house that takes cost out of the equation and makes dependency management simple.
That wraps up Data Day! Check out the AWS ANZ User Group YouTube channel for more