July ’20 Heartbeat

Catch up on new DVC releases, talks, and projects in our community. This month, we recap the DVC 1.0 release, making the list of top 20 fastest growing open-source startups, and interviews galore. Plus: 📣 an invitation to the next DVC meetup!

  • Elle O'Brien
  • July 10, 20207 min read
Hero Picture

Welcome to the July Heartbeat, our monthly roundup of new releases, talks, great articles, and upcoming events in the DVC community.

News

DVC 1.0 release

On June 22, DVC entered a new era: the official release of version 1.0. After several weeks of bug-catching with our pre-release, the team has issued DVC 1.0 for the public! Now when you install DVC through your package manager of choice, you'll get the latest version. Welcome to the future.

To recap, DVC 1.0 has some big new features like:

  • Plots powered by Vega-Lite so you can compare metrics across commits
  • New and easier pipeline configuration files- edit your DVC pipeline like a text file!
  • Optimizations for data transfer speed

Read all the release notes for more, and stop by our Discord if you need support migrating (don't worry, 1.0 is backwards compatible).

Virtual meetup!

In May, we had our first every virtual meetup. We had amazing talks from Dean Pleban and Elizabeth Hutton, plus time for Q&A with the DVC team- you can watch the recording if you missed it!

On Thursday, July 30, we're hosting our second meetup! Ambassador Marcel Ribeiro-Dantas is hosting once again. We'll have short talks about causal modeling and CI/CD, plus lots of time for chatting and catching up. Please RSVP!

July DVC Meetup: Data Science & DevOps!

This meetup will be hosted by DVC Ambassador Marcel! AGENDA:We have two 10-minute talks on the agenda:- Causal Modeling with DVC - Marcel- Continuous integration for ML case studies - Elle Following talks, we'll have Q&A with the DVC team and time for community discussion.

DVC is in the top 20 fastest-growing open source startups

Konstantin Vinogradov at Runa Capital used the GitHub API to identify the fastest growing public repositories on GitHub in terms of stars and forks. He used these metrics to estimate the top 20 fastest growing startups in open source software. And guess what, DVC made the cut! We're in great company.

top20startups

New team member

We have a new teammate-Maxim Shmakov, previously of Yandex, is joining us! Maxim is a front-end engineer joining us from Moscow. Please welcome him to DVC. 👋

Community activity

We've been busy! Although we are mostly homebound these days, there has been no shortage of speaking engagements. Here's a recap.

Meetings and talks

  • Dmitry appeared on the MLOps.community meetup to chat with host Demetrios Brinkmann. They talked about the open source ecosystem, the difference between tools and platforms, and what it means to codify data.
  • I (Elle) gave a talk at the MLOps Production & Engineering World meeting, called "Adapting continuous integration and continuous delivery for ML". I shared an approach to using GitHub Actions with ML projects. Video coming soon!
  • Extremely early the next morning, clinician-scientist Cris Lanting and I co-led a workshop about developing strong computational infrastructure and practices in research as part of the Virtual Conference on Computational Audiology. We talked about big ideas for making scientific research reproducible, manageable, and shareable. For the curious, the workshop is still viewable!

Good reads

Some excellent reading recommendations from the community:

  • Data scientist Déborah Mesquita published a thorough guide to using new DVC 1.0 pipelines in a sample ML project. It's truly complete, covering data collection to model evaluation, with detailed code examples. If you are new to pipelines, do not miss this!

The ultimate guide to building maintainable Machine Learning pipelines using DVC

Learn the principles for building maintainable Machine Learning pipelines using DVC
The ultimate guide to building maintainable Machine Learning pipelines using DVC

  • Caleb Kaiser of Cortex (another startup in the Runa Capital's Top 20 list!) shared a thinkpiece about challenges from software engineering that can inform production ML. We really agree with what he has to say about reproducibility:

You typically hear about “reproducibility” in reference to ML research, particularly when a paper doesn’t include enough information to recreate the experiment. However, reproducibility also comes up a lot in production ML. Think of it this way — you’re on a team staffed with data scientists and engineers, and you’re all responsible for an image classification API. The data scientists are constantly trying new techniques and architectural tweaks to improve the model’s baseline performance, while at the same time, the model is constantly being retrained on new data. Looking over the APIs performance, you see one moment a week ago where the model’s performance dropped significantly. What caused that drop? Without knowing exactly how the model was trained, and on what data, it’s impossible to know for sure.

What software engineers can bring to machine learning

Many production machine learning challenges are paralleled in software engineering
What software engineers can bring to machine learning

  • Mukul Sood wrote about the Real World, a place beyond Jupyter notebooks where data is non-stationary and servers are unreliable! He covers some very real challenges for taking a data science project into production and introduces the need for CI/CD practices in healthy, scalable ML applications.

Scaling Machine Learning in the Real World

Any conversation around scaling or productionizing data science, would need to talk about Continuous Integration/Continuous Deployment.
Scaling Machine Learning in the  Real World

A nice tweet

We'll close on a nice tweet from Russell Jurney:

Thanks, we couldn't do it without our community! As always, thanks for joining us and reading. There are lots of ways to stay in touch and we always love to hear from you. Follow us on Twitter, join our Discord server, or leave a blog comment. Until next time! 😎

Subscribe for updates. We won't spam you.