Data Engineering with Dagster
4 weeks β€” US$ 400
Not ready? for new sessions.
Space is limited
Course logo

Data Engineering with Dagster

A well built data platform allows for fast iteration and safe deployments. This course will teach you how to design, build, and maintain a data platform that supports a wide range of data tasks.You will start by taking a simple data workflow, common to most companies, and deconstructing it to its core components. By the end of the course, you will reimplement the pipeline using modern data frameworks, running in the cloud.

Instructor profile photo
Dennis Hume
Staff Data Engineer at Dutchie
Price
US$ 400
Course Duration
4 weeks
Start Date
August 15
Registration By
August 12
Lecture
Monday @ 3:00 PM UTC
Project Sessions
Wednesday @ 3:00 PM UTC or
Wednesday @ 11:00 PM UTC
Learn alongside a small group of your professional peers
Connect with experts through live sessions and office hours
Real-world projects that teach you industry skills.
Created and taught by
Instructor Photo
Link to an instructor's LinkedIn profile

Dennis Hume

Staff Data Engineer at Dutchie

Dennis is a Staff Data Engineer at Dutchie. He has over a decade+ experience in the data space, focusing on platform engineering and data infrastructure. He has helped many companies improve their data stacks, starting from Wolfram Alpha and Epic, and most recently Dutchie and Drizly.

Affiliation logo
The course

Companies have a growing number of data applications to perform mission-critical tasks. Despite the increasingly important roles these applications are playing, many are not well understood by the engineers who are implementing them. This hinders experimentation and increases the risk involved with future changes and feature implementation.

Part of the problem is that seemingly simple data applications often rely on numerous systems. This complexity is not always appreciated when data teams stand up simple ad hoc processes. As a result, these systems often scale poorly as data volumes increase.

Over the next four weeks, we will discuss the importance of an effective data platform and the attributes that empower data analysts and data scientists to do their best work. We will design a data platform using Dagster, and we will tailor the environment using Docker for local development and fast iteration. We will use AWS to manage and run our platform at scale. By the end of class, you will feel confident implementing a data stack tailored to your organization, and you will feel confident knowing that your platform will be able to handle any specific workflow you need to support.

1
Week 1
Data Platform Principles
Learn
  • The challenges of building data applications
  • How to deconstruct a data workflows into its key components
  • Docker and designing a local environment
Project
Deconstruct a simple data pipeline into its components can that be tested locally within Docker
    2
    Week 2
    Dagster DAG
    Learn
    • Fundamentals of Dagster
    • How to handle some of the complexities of data workflows
    Project
    Implement a data pipeline from into a robust workflow using Dagster and leveraging its core abstractions
      3
      Week 3
      Dagster Project
      Learn
      • How to view individuals workflows as existing within a full data application
      • Building both scheduled and event based processes
      • Manage and isolate dependencies
      Project
      Include your data workflow as one of many in a fully functional Dagster project and the multiple ways to execute your workflows
        4
        Week 4
        Software Assets and Deployments
        Learn
        • Define software assets within your Dagster project
        • Discuss how to deploy Dagster
        Project
        A Dagster project backed by assets and a practical data mesh
          Ian MacomberHead of Analytics and Architecture of Ramp

          Dennis Hume is an expert and mentor on how to build out data platforms and support data teams. Dennis knows the past/present/future of the modern data stack intimately, and how to enable companies to graduate from analytics engineering batch SQL workflows to realtime, python, and machine learning services. He's a leading voice in the data community (see his talks on Dagster, Materialize, Modern Data Stack conference, and more). Any analytics engineer or data scientist would be lucky to work with Denins, and anyone lucky enough to learn from Dennis should hop at the opportunity!

          Antall FernandesDirector of Engineering at Till Financial

          Dennis brings with him ample industry experience when it comes to designing and delivering on data platform solutions. In addition to building out the data platform at Drizly, he has been instrumental in leveling up others on topics pertaining to the data space. The clarity of thought and the structured approach to delivering solutions makes it very easy for one to engage and learn with Dennis.

          This course is for...

          Data Engineers looking to build more reliable pipelines to support their analytics team

          Software engineers who want to be more involved in building reliable data applications

          Prerequisites

          Ability to write Python and work with documented libraries

          Comfort working with Docker basics (start, stop) and the command line

          Course experience

          Live Sessions with Experts

          Top industry leaders teach you everything you need in only 4 weeks

          Interactive Learning

          Real-world projects put your learning into immediate action

          Professional Communities

          Grow your network by learning with an intimate cohort of peers from top companies
          ?
          Frequently Asked Questions
          Stay in the loop
          Keep in touch for updates, discounts, and new course sessions.
          Backed by top VCs, including
          VCs
          Teach
          Share your unique expertise with the world.
          Enterprise
          Receive best-in-class skills training for your teams and organization.
          Careers
          Join us as we change the future of online education.
          Β© 2021 - 2022 Corise Education. Terms of Service. Privacy Policy.
          Questions? Email us atΒ hello@corise.com