Infrastructure as Code is an approach to machine provisioning and setup in which a programmer describes the underlying services they need for their projects.  However, this infrastructure code doesn’t compile a binary artifact like traditional source code.  The successful completion of running the code signals that the servers and other components described in the configuration The post Infrastructure as Code with Christian Tragesser appeared first on Software Engineering Daily.

Data – Software Engineering Daily

Infrastructure as Code with Christian Tragesser

The first industrial deployments of machine learning and artificial intelligence solutions were bespoke by definition and often had brittle operating characteristics.  Almost no one builds custom databases, web servers, or email clients.  Yet technology groups today often consider developing homegrown ML and data solutions in order to solve their unique use cases.  Today’s modern data The post Modern Data Infrastructure and Tools with Leigh Marie Braswell appeared first on Software Engineering Daily.

Modern Data Infrastructure and Tools with Leigh Marie Braswell

In a version control system, a Monorepo is a version control management strategy in which all your code is contained in one potentially large but complete repository.  The monorepo is in stark contrast to an alternative approach in which software teams independently manage microservices or deliver software as libraries to be imported in other projects.  The post Git Scales for Monorepos with Derrick Stolee appeared first on Software Engineering Daily.

Git Scales for Monorepos with Derrick Stolee

Companies that gather data about their users have an ethical obligation and legal responsibility to protect the personally identifiable information in their dataset.  Ideally, developers working on a software application wouldn’t need access to production data. Yet without high-quality example data, many technology groups stumble on avoidable problems.  Organizations need a solution to protect privacy The post Faking Data Using Tonic AI with Ian Coe and Adam Kamor appeared first on Software Engineering Daily.

Faking Data Using Tonic AI with Ian Coe and Adam Kamor

Applications write data to persistent storage like a database.  The most popular database query language is SQL which has many similar dialects.  SQL is expressive and powerful for describing what data you want.  What you do with that data requires a solution in the form of a data pipeline.  Ideally, these analytical workflows can follow The post DBT: Data Build Tool with Tristan Handy appeared first on Software Engineering Daily.

DBT: Data Build Tool with Tristan Handy

Tedious, repetitive tasks are better handled by machines.  Unless these tasks truly require human intelligence, repetitive tasks are often good candidates for automation.  Implementing process automation can be challenging and technical.  Increasingly, engineers are seeking out tools and platforms to facilitate faster, more reliable automation. In this episode I talk to Yaseer Sheriff, Co-Founder and The post No Code Process Automation at Axiom with Yaseer Sheriff appeared first on Software Engineering Daily.

No Code Process Automation at Axiom with Yaseer Sheriff

A developer’s core deliverables are individual commits and the pull requests they aggregate into. While the number of lines of code written alone may not be very informative, in total, the code and metadata about the code found in tracking systems present a rich dataset with great promise for analysis and productivity optimization insights. LinearB The post LinearB with Dan Lines appeared first on Software Engineering Daily.

LinearB with Dan Lines

Modern companies leverage dozens or even hundreds of software solutions to solve specific needs of the business.  Organizations need to collect all these disparate data sources into a data warehouse in order to add value.  The raw data typically needs transformation before it can be analyzed.  In many cases, companies develop homegrown solutions, thus reinventing The post Modern Data Stacks Optimized by Mozart Data with Peter Fishman and Dan Silberman appeared first on Software Engineering Daily.

Modern Data Stacks Optimized by Mozart Data with Peter Fishman and Dan Silberman

Instabase is a technology platform for building automation solutions. Users deploy it onto their own infrastructure and can leverage the tools offered by the platform to build complex workflows for handling tasks like income verification and claims processing. In this episode we interview Anant Bhardwaj, founder of Instabase. He describes Instabase as an operating system.  The post Instabase with Anant Bhardwaj appeared first on Software Engineering Daily.

Instabase with Anant Bhardwaj

Shinji Kim is Founder and CEO of Select Star. In this episode we discuss data discovery and more. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Data Discovery with Shinji Kim appeared first on Software Engineering Daily.

Data Discovery with Shinji Kim

Time series data are simply measurements or events that are tracked, monitored, downsampled, and aggregated over time. This could be server metrics, application performance monitoring, network data, sensor data, events, clicks, trades in a market, and many other types of analytics data (influxdata.com). The platform InfluxData is designed for building and operating time series applications. The post InfluxData: Time-Series Data with Russ Savage appeared first on Software Engineering Daily.

InfluxData: Time-Series Data with Russ Savage

Whether sending messages, shopping in an app, or watching videos, modern consumers expect information and responsiveness to be near-instant in their apps and devices. From a developer’s perspective, this means clean code and a fast database.  Apache Druid is a database built to power real-time analytic workloads for event-driven data, like user-facing applications, streaming, and The post Druid: Event-Driven Data with Eric Tschetter appeared first on Software Engineering Daily.

Druid: Event-Driven Data with Eric Tschetter

Auren Hoffman is the CEO of SafeGraph. In this episode we discuss data as a service and more. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post DaaS with Auren Hoffman appeared first on Software Engineering Daily.

DaaS with Auren Hoffman

Enterprise data warehouses store all company data in a single place to be accessed, queried, and analyzed. They’re essential for business operations because they support managing data from multiple sources, providing context, and have built-in analytics tools. While keeping a single source of truth is important, easily moving data from the warehouse to other applications The post Reverse ETL: Operationalizing Data Warehouses with Tejas Manohar appeared first on Software Engineering Daily.

Reverse ETL: Operationalizing Data Warehouses with Tejas Manohar

Prophecy is a complete Low-Code Data Engineering Platform for the Enterprise. Prophecy enables all your teams on Apache Spark with a unique low-code designer. While you visually build your Dataflows – Prophecy generates high-quality Spark code on Git. Then, you can schedule Spark workflows with Prophecy’s low-code Airflow. Not only that, Prophecy provides end-to-end visibility The post Prophecy: Apple of Data Engineering with Raj Bains appeared first on Software Engineering Daily.

Prophecy: Apple of Data Engineering with Raj Bains

Databases and data engineering episodes of Software Engineering Daily