Many startups today begin their life as an open-source project. Open source projects allow early adopters of a technology to experiment, to contribute code and feedback, and to shape the evolution of the project in its early stages. When a “community maintainer” company emerges to provide service offerings based on that project, its early customer The post Developer Community Management with Patrick Woods and Josh Dzielak appeared first on Software Engineering Daily.

Open Source – Software Engineering Daily

Developer Community Management with Patrick Woods and Josh Dzielak

ELT, or “Extract, Load, and Transform,” is the process that modern data pipelines use to replicate data from a source and load it into a target system such as a cloud data warehouse. ELT is a more flexible evolution of the traditional “Extract, Load, Transform” workflow used in pre-cloud systems. The power of ELT relies The post Airbyte: Open Source Data Integrations with Michel Tricot and John Lafleur appeared first on Software Engineering Daily.

Airbyte: Open Source Data Integrations with Michel Tricot and John Lafleur

The complexity of building web applications seems to have grown exponentially in the last several years. This added complexity may bring power, but it can also make applications brittle, costly, and difficult to maintain. Suborbital is an open-source project with a goal of making web application development simple. Its flagship project is Atmo, a platform The post Suborbital: WebAssembly Infrastructure with Connor Hicks appeared first on Software Engineering Daily.

Suborbital: WebAssembly Infrastructure with Connor Hicks

Observability is a key feature of a well-architected application. Because building an observability system for a cloud application can be challenging, especially at scale, many organizations elect to use third-party observability platforms rather than build internal tools. But these third-party provider contracts often charge by volume of data collected, which can be unpredictable and difficult The post Opstrace: Open Source Observability with Sebastien Pahl appeared first on Software Engineering Daily.

Opstrace: Open Source Observability with Sebastien Pahl

As the volume and scope of data collected by an organization grow, tasks such as data discovery and data management grow in complexity. Simply put, the more data there is, the harder it is for users such as data analysts to find what they’re looking for. A metadata hub helps manage Big Data by providing The post Datahub: Open Source Data Lake with Pardhu Gunnam and Mars Lan appeared first on Software Engineering Daily.

Datahub: Open Source Data Lake with Pardhu Gunnam and Mars Lan

The shift to microservices architectures and distributed systems has been a challenge for systems using conventional security practices, such filtering IP addresses using network policies. In addition, the increasing intersection of development and operations exemplified by the DevOps methodology has expanded the scope responsibilities in implementing secure systems.  Part of CNCF, SPIFFE is a set The post SPIFFE and SPIRE with Derek Edwards and Ryan Turner appeared first on Software Engineering Daily.

SPIFFE and SPIRE with Derek Edwards and Ryan Turner

A data warehouse is a centralized repository that an enterprise may use to store selected data from production systems. Data is transformed into a structured form that makes it easily accessible for business intelligence or other operational users. SQL-compliant databases are frequently used for data warehouses due to the popularity of SQL as a tool The post Postgres Data Warehouse with Josh Drake and Thomas Richter appeared first on Software Engineering Daily.

Postgres Data Warehouse with Josh Drake and Thomas Richter

Open source software is software distributed along with its source code, using a permissive license that allows anyone to view, use, or modify it. The term “open source” also refers more broadly to a philosophy of technology development which prioritizes transparency and community development of a project. Typically, development is managed by a governing body, The post Open Source Industrialization with Kevin Xu appeared first on Software Engineering Daily.

Open Source Industrialization with Kevin Xu

Originally published October 18, 2019 Apache Kafka was created at LinkedIn. Kafka was open sourced in 2011, when the company was eight years old. By that time, LinkedIn had developed a social network with millions of users. LinkedIn’s engineering team was building a range of externally facing products and internal tools, and many of these The post LinkedIn Kafka with Nacho Solis (Repeat) appeared first on Software Engineering Daily.

LinkedIn Kafka with Nacho Solis (Repeat)

Originally published September 17, 2019 Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka The post Kafka Applications with Tim Berglund (Repeat) appeared first on Software Engineering Daily.

Kafka Applications with Tim Berglund (Repeat)

Originally published May 16, 2019 React is a set of open source tools for building user interfaces. React was open sourced by Facebook, and includes libraries for creating interfaces on the web (ReactJS) and on mobile devices (React Native). React was released during a time when there was not a dominant frontend JavaScript library. Backbone, The post Facebook React with Dan Abramov (Repeat) appeared first on Software Engineering Daily.

Facebook React with Dan Abramov (Repeat)

Business intelligence is crucial for both internal and external applications at any company. There is a wide array of proprietary BI tools. Today, there is an increasing number of options for open source business intelligence, one of which is CubeJS. CubeJS is an open source analytical API platform for building BI. Artyom and Pavel from The post CubeJS with Artyom Keydunov and Pavel Tiunov appeared first on Software Engineering Daily.

CubeJS with Artyom Keydunov and Pavel Tiunov

Infrastructure at Spotify runs at high speeds. Developers work autonomously, building and deploying services all the time. Backstage is an open source platform built at Spotify that allows developers to build portals for making sense of their infrastructure. Backstage developer portals are powered by a central service catalog, with centralized services and streamlined development. Stefan The post Backstage: Spotify Developer Portals with Stefan Ålund appeared first on Software Engineering Daily.

Backstage: Spotify Developer Portals with Stefan Ålund

Firebase is well-known as a platform that makes it easy to build real-time applications quickly and easily. Firebase was acquired by Google, and has been turned into a large platform that runs on top of Google Cloud. Firebase is closed-source, which leads to a different ecosystem than open source platforms. Supabase is a new open The post Supabase: Open Source Firebase with Paul Copplestone appeared first on Software Engineering Daily.

Supabase: Open Source Firebase with Paul Copplestone

Business intelligence tooling allows analysts to see large quantities of data presented to them in a flexible interface including charts, graphs, and other visualizations. BI tools have been around for decades, and as the world moves towards increased open source software, the business intelligence tools are following that trend. Metabase is an open source business The post Metabase: Business Intelligence Open Source with Sameer Al-Sakran appeared first on Software Engineering Daily.

Metabase: Business Intelligence Open Source with Sameer Al-Sakran

Open source technology episodes of Software Engineering Daily