Software Engineering Daily

Great Expectations: Data Pipeline Testing with Abe Gong

Mon, 17 Feb 2020 10:00:50 +0000

A data pipeline is a series of steps that takes large data sets and creates usable results from them. At the beginning of a data pipeline, a data set might be pulled from a database, a distributed file system, or a Kafka topic. Throughout a data pipeline, different data sets are joined, filtered, and statistically

The post Great Expectations: Data Pipeline Testing with Abe Gong appeared first on Software Engineering Daily.

Data Warehouse ETL with Matthew Scullion

Fri, 14 Feb 2020 10:00:29 +0000

A data warehouse provides low latency access to large volumes of data. A data warehouse is a crucial piece of infrastructure for a large company, because it can be used to answer complex questions involving a large number of data points. But a data warehouse usually cannot hold all of a company’s data at any

The post Data Warehouse ETL with Matthew Scullion appeared first on Software Engineering Daily.

Anyscale with Ion Stoica

Thu, 13 Feb 2020 10:00:34 +0000

Machine learning applications are widely deployed across the software industry. Most of these applications used supervised learning, a process in which labeled data sets are used to find correlations between the labels and the trends in that underlying data. But supervised learning is only one application of machine learning. Another broad set of machine learning

The post Anyscale with Ion Stoica appeared first on Software Engineering Daily.

Flink and BEAM Stream Processing with Maximilian Michels

Wed, 12 Feb 2020 10:00:07 +0000

Distributed stream processing systems are used to read large volumes of data and perform operations across those data streams. These stream processing systems often build off of the MapReduce algorithm for collecting and aggregating large volumes of data, but instead of processing a calculation over a single large batch of data, they process data on

The post Flink and BEAM Stream Processing with Maximilian Michels appeared first on Software Engineering Daily.

Druid Analytics with Jad Nauous

Tue, 11 Feb 2020 10:00:19 +0000

Large companies generate large volumes of data. This data gets dumped into a data lake for long-term storage, then pulled into memory for processing and analysis. Once it is in memory, it is often read into a dashboard, which presents a human with a visualization of the data. The end-user who is consuming this data

The post Druid Analytics with Jad Nauous appeared first on Software Engineering Daily.

The Data Exchange with Ben Lorica

Mon, 10 Feb 2020 10:00:29 +0000

Data infrastructure has been transformed over the last fifteen years. The open source Hadoop project led to the creation of multiple companies based around commercializing the MapReduce algorithm and Hadoop distributed file system. Cheap cloud storage popularized the usage of data lakes. Cheap cloud servers led to wide experimentation for data tools. Apache Spark emerged

The post The Data Exchange with Ben Lorica appeared first on Software Engineering Daily.

Presto with Justin Borgman

Fri, 07 Feb 2020 10:00:21 +0000

A data platform contains all of the data that a company has accumulated over the years. Across a data platform, there is a multitude of data sources: databases, a data lake, data warehouses, a distributed queue like Kafka, and external data sources like Salesforce and Zendesk. A user of the data platform often has a

The post Presto with Justin Borgman appeared first on Software Engineering Daily.

Nubank Data Engineering with Sujith Nair

Thu, 06 Feb 2020 10:00:03 +0000

Nubank is a popular bank that is based in Brazil. Nubank has more than 20 million customers, and has accumulated a high volume of data over the six years since it was started. Mobile computing and cloud computing have given rise to “challenger banks” that operate more like software companies. When a software company reaches

The post Nubank Data Engineering with Sujith Nair appeared first on Software Engineering Daily.

Changelog Podcasting with Adam Stacoviak and Jerod Santo

Wed, 05 Feb 2020 10:00:05 +0000

The Changelog is a podcast about the world of open source. As open source has become closely tied with the entire software development lifecycle, The Changelog has expanded its coverage to the broader software industry. Since starting the podcast ten years ago, Adam Stacoviak and Jerod Santo have become full-time podcasters, and they have started

The post Changelog Podcasting with Adam Stacoviak and Jerod Santo appeared first on Software Engineering Daily.

Rive: Animation Tooling with Guido and Luigi Rosso

Tue, 04 Feb 2020 10:00:42 +0000

Animations can be used to create games, app tutorials, and user interface components. Animations can be seen in messaging apps, where animated reactions can convey rich feelings over a text interface. Loading screens can become less boring through animation, and voice assistant products can feel more alive through animation. But we still don’t see much

The post Rive: Animation Tooling with Guido and Luigi Rosso appeared first on Software Engineering Daily.

John Deere: Farm Software with Ryan Bergman

Mon, 03 Feb 2020 10:00:19 +0000

Robotics has changed modern agriculture. Autonomous systems are powering the tractors, cotton pickers, and corn cutters that yield plants at industrial scale. John Deere is a company that has been making farm equipment for 183 years. Over that period, the planting and harvesting process has become increasingly mechanized, and John Deere has been at the

The post John Deere: Farm Software with Ryan Bergman appeared first on Software Engineering Daily.

Venture Stories with Erik Torenberg

Fri, 31 Jan 2020 10:00:20 +0000

Venture capital investing requires an understanding of market dynamics, technology, and finance. There is also an element of human nature. Consumer trends can make or break the viability of a new product. And early stage venture investing is always a bet on a small team or individual founder. Early stage investments are usually into companies

The post Venture Stories with Erik Torenberg appeared first on Software Engineering Daily.

Alpaca: Stock Trading API with Yoshi Yokokawa

Thu, 30 Jan 2020 10:00:44 +0000

Stock trading takes place across a variety of software platforms. Etrade and Schwab have allowed individual traders to buy securities for decades. Robinhood built a business around a similar model, but also removed the commission. Wealthfront and Betterment provide “roboadvisor” services that abstract away the underlying securities and focus on managing a risk profile. Each

The post Alpaca: Stock Trading API with Yoshi Yokokawa appeared first on Software Engineering Daily.

Cloud Log Analysis with Jack Naglieri

Wed, 29 Jan 2020 10:00:07 +0000

Large software companies have lots of users, and the activity from those users results in high volumes of traffic. These companies also have a large surface area across the enterprise. There are hundreds of services and databases that are fulfilling user requests. As these requests enter the infrastructure of the enterprise, the requests travel through

The post Cloud Log Analysis with Jack Naglieri appeared first on Software Engineering Daily.

Replicated Software Delivery with Grant Miller and Marc Campbell

Tue, 28 Jan 2020 10:00:48 +0000

Distributed systems are required to run most modern enterprise software. Application services need multiple instances for scalability and failover. Large databases are sharded onto multiple nodes. Logging services, streaming frameworks, and continuous integration tools all require the orchestration of more than one server. Deploying a distributed system has historically been difficult because the nodes of

The post Replicated Software Delivery with Grant Miller and Marc Campbell appeared first on Software Engineering Daily.

Mattermost with Ian Tien

Mon, 27 Jan 2020 10:00:54 +0000

Chat systems have been a part of software development for decades. Older systems like Pidgin and Yammer were surpassed by newer systems like HipChat. And when Slack was created, it quickly became a part of most software companies. But Slack does not fulfill the needs of every company. Mattermost is an open-source chat system. Mattermost

The post Mattermost with Ian Tien appeared first on Software Engineering Daily.

GitLab Strategy with Sid Sibrandij

Fri, 24 Jan 2020 10:00:09 +0000

The word “DevOps” has a different definition depending on who you ask. For some people, it is about the process of managing and releasing code. It can involve container management and server orchestration. It can involve infrastructure-as-code, and safer configuration management. In addition to a set of technologies, DevOps can be seen as a management

The post GitLab Strategy with Sid Sibrandij appeared first on Software Engineering Daily.

Lyft Kubernetes with Vicki Cheung

Thu, 23 Jan 2020 10:00:36 +0000

The ridesharing infrastructure of Lyft has a high volume of traffic that is mostly handled by servers on AWS. When Vicki Cheung joined Lyft in 2018, the company was managing containers with an internally built container scheduler. One of her primary goals at the company was to move Lyft to Kubernetes. In today’s episode, Vicki

The post Lyft Kubernetes with Vicki Cheung appeared first on Software Engineering Daily.

DFINITY: The Internet Computer with Dominic Williams

Wed, 22 Jan 2020 10:00:20 +0000

If the Internet was reimagined with the software and hardware infrastructure we have today, what would it look like? That is the question that DFINITY is working on answering. DFINITY’s goal is to build a decentralized, secure Internet computer. DFINITY takes concepts from the cryptocurrency world, but it is focused on computation, not financial products.

The post DFINITY: The Internet Computer with Dominic Williams appeared first on Software Engineering Daily.

Webflow Engineering with Bryant Chou

Tue, 21 Jan 2020 10:00:59 +0000

Webflow is a visual programming tool used by designers, developers, and other technical users. Webflow is a leader in the “low code” or “no code” category of software tools that has become prominent in the last few years. Webflow has been years in the making. In a previous show with Webflow CEO Vlad Magdalin, he

The post Webflow Engineering with Bryant Chou appeared first on Software Engineering Daily.

Software Media with Tim O’Reilly

Mon, 20 Jan 2020 10:00:24 +0000

Software has changed the way the world functions. The rapid pace of change has made it difficult to know how to navigate the new world. Knowledge workers who want to keep advancing in their careers develop a strategy of continuous learning in order to adapt to these changes. O’Reilly Media has existed for almost 40

The post Software Media with Tim O’Reilly appeared first on Software Engineering Daily.

Apollo GraphQL with Geoff Schmidt

Fri, 17 Jan 2020 10:00:05 +0000

GraphQL has become a core piece of infrastructure for many software applications. GraphQL is used to make requests that are structured as GraphQL queries and responded to through a GraphQL server. The GraphQL server processes the query and fetches the response from the necessary databases, APIs, and backend services. Around 2016, when GraphQL was becoming

The post Apollo GraphQL with Geoff Schmidt appeared first on Software Engineering Daily.

JS Party with Kevin Ball

Thu, 16 Jan 2020 10:00:30 +0000

The JavaScript ecosystem stretches across frontend, backend, and middleware. There are newer tools such as GraphQL, Gatsby, and WebAssembly. There are frameworks like React, Vue, and Angular. There is complex data handling with streams, caches, and TensorFlow.js. JavaScript is unlike any other ecosystem, because a single language can be used to construct every part of

The post JS Party with Kevin Ball appeared first on Software Engineering Daily.

Packet: Baremetal Infrastructure with Zachary Smith and Nathan Goulding

Wed, 15 Jan 2020 10:00:19 +0000

Cloud infrastructure is usually consumed in the form of virtual machines or containers. These VMs or containers are running on a physical host machine that is also running other VMs and containers. This is called multitenancy. Servers across cloud providers such as AWS have a high utilization because there are multiple virtual instances running on

The post Packet: Baremetal Infrastructure with Zachary Smith and Nathan Goulding appeared first on Software Engineering Daily.

Edge Computing Platform with Jaromir Coufal

Tue, 14 Jan 2020 10:00:59 +0000

Edge computing is the usage of servers that are geographically close to the client device. The first common use case for edge computing was CDNs: content-delivery networks. A content delivery network placed media files such as images and videos on multiple servers throughout the world. These are big files, and they take lots of bandwidth

The post Edge Computing Platform with Jaromir Coufal appeared first on Software Engineering Daily.

Data Infrastructure Go-To-Market with Sean Knapp

Mon, 13 Jan 2020 10:00:59 +0000

Every large company generates large amounts of data. Data engineering is the process of storing, transforming, and leveraging that data. Data infrastructure companies provide tools and platforms for performing data engineering. The last fifteen years has seen a rise in modern data management companies built in a time of decreasing storage costs, an increased volume

The post Data Infrastructure Go-To-Market with Sean Knapp appeared first on Software Engineering Daily.

Slack Data Platform with Josh Wills

Fri, 10 Jan 2020 10:00:46 +0000

Slack is a messaging platform for organizations. Since its creation in 2013, Slack has quickly become a core piece of technology used by a wide variety of technology companies, groups, and small teams. The messages that are sent on Slack are generated at a very high volume, and are extremely sensitive. These messages must be

The post Slack Data Platform with Josh Wills appeared first on Software Engineering Daily.

NoSQL Optimization with Rick Houlihan

Thu, 09 Jan 2020 10:00:34 +0000

NoSQL databases provide an interface for storing and accessing data that allows the user to work with data in an “unstructured” fashion. SQL databases require the data in the database to be “normalized,” meaning that each object in the entire database has an entry (or a null value) for each field. One advantage of NoSQL

The post NoSQL Optimization with Rick Houlihan appeared first on Software Engineering Daily.

Amazon EC2 with Dave Brown

Wed, 08 Jan 2020 10:00:20 +0000

Amazon EC2 (Elastic Compute Cloud) is a virtualized server product that provides the user with scalable compute infrastructure. EC2 was created in 2006 as one of the first three AWS services along with S3 and Simple Queueing Service. Since then, EC2 has provided the core server infrastructure for many of the companies that have been

The post Amazon EC2 with Dave Brown appeared first on Software Engineering Daily.

Amazon Kubernetes with Abby Fuller

Tue, 07 Jan 2020 10:00:37 +0000

Amazon’s container offerings include ECS (Elastic Container Service), EKS (Elastic Kubernetes Service), and Fargate. Through these different offerings, Amazon provides a variety of ways that a user can manage Kubernetes clusters and standalone container instances. The choice of which containerization system to choose depends on the needs of the user, and the tradeoffs they want

The post Amazon Kubernetes with Abby Fuller appeared first on Software Engineering Daily.

Kubernetes Progress with Kelsey Hightower

Mon, 06 Jan 2020 10:00:18 +0000

When the Kubernetes project was started, Amazon Web Services was the dominant cloud provider. Most of the code that runs AWS is closed source, which prevents an open ecosystem from developing around AWS. Developers who deploy their application onto AWS are opting into a closed, controlled ecosystem, which has both costs and benefits. The software

The post Kubernetes Progress with Kelsey Hightower appeared first on Software Engineering Daily.

freeCodeCamp with Quincy Larson

Fri, 20 Dec 2019 10:00:48 +0000

freeCodeCamp was started five years ago with the goal of providing free coding education to anyone on the Internet. freeCodeCamp has become the best place to begin learning how to write software. There are many other places that a software engineer should visit on their educational journey, but freeCodeCamp is the best place to start,

The post freeCodeCamp with Quincy Larson appeared first on Software Engineering Daily.

No Code with Shawn Wang

Thu, 19 Dec 2019 10:00:56 +0000

The software category known as “no-code” describes a set of tools that can be used to build software without writing large amounts of code in a programming language. No-code tools use visual interfaces such as spreadsheets and web based drag-and-drop systems. In previous shows, we have covered some of the prominent no-code products such as

The post No Code with Shawn Wang appeared first on Software Engineering Daily.

Roblox Engineering with Claus Moberg

Wed, 18 Dec 2019 10:00:57 +0000

Roblox is a gaming platform with a large ecosystem of players, creators, game designers, and entrepreneurs. The world of Roblox is a three-dimensional environment where characters and objects interact through a physics engine. Roblox is multiplayer, and users can interact with each other over the Internet. Roblox is not one single game—it is a system

The post Roblox Engineering with Claus Moberg appeared first on Software Engineering Daily.

Kubernetes at Cruise with Karl Isenberg

Tue, 17 Dec 2019 10:00:45 +0000

Cruise is a company that is building a fully automated self-driving car service. The infrastructure of a self-driving car platform presents a large number of new engineering problems. Self-driving cars collect vast quantities of data as they are driving around the city. This data needs to be transferred from the cars onto cloud servers. The

The post Kubernetes at Cruise with Karl Isenberg appeared first on Software Engineering Daily.

Snyk: Open Source Security with Guy Podjarny

Mon, 16 Dec 2019 10:00:23 +0000

The software supply chain includes cloud infrastructure, on-prem proprietary solutions, APIs, programming languages, networking products, and open source software. Each of these software categories has its own security vulnerabilities, and each category has tools that can help protect a company from attackers that are trying to exploit known vulnerabilities. As open source software has grown

The post Snyk: Open Source Security with Guy Podjarny appeared first on Software Engineering Daily.

GitLab Engineering with Marin Jankovski

Fri, 13 Dec 2019 10:00:49 +0000

GitLab is a company that builds an open source platform for managing git repositories. GitLab was started in 2012, and has grown to have a large enterprise business with additional products such as continuous integration and security tooling. GitLab is also known for being a large, entirely remote workforce. GitLab does not have any offices,

The post GitLab Engineering with Marin Jankovski appeared first on Software Engineering Daily.

Basic Income with Floyd Marinescu

Thu, 12 Dec 2019 10:00:47 +0000

Automation has the potential to eliminate rote jobs such as call center workers and truck drivers. The downstream effects of automation also leads to new jobs, such as data labeling and robot operations. The net effect of modern automation technology is unclear, but it is likely to cause some disruption in the job market. Universal

The post Basic Income with Floyd Marinescu appeared first on Software Engineering Daily.

Continuous Intelligence with Kalyan Ramanathan

Wed, 11 Dec 2019 10:00:45 +0000

Logging provides raw data that can be abstracted into higher level information. Logs are generated at every layer of infrastructure: physical host, virtual machine, container, pod, and Kubernetes cluster. Logs are generated by network proxies, edge servers, and API requests. There is far too much logging information to be read by humans. Log messages need

The post Continuous Intelligence with Kalyan Ramanathan appeared first on Software Engineering Daily.

Remote Work with Philip Thomas

Tue, 10 Dec 2019 10:00:43 +0000

Offices have historically been the place where most knowledge work takes place. An office is a central meeting point for everyone in an organization. Offices allow for high bandwidth, in-person communication. Employees have access to shared resources, such as food, tables, and quiet working space. Offices provide a means of encouraging a common culture within

The post Remote Work with Philip Thomas appeared first on Software Engineering Daily.

Practical AI with Chris Benson

Mon, 09 Dec 2019 10:00:41 +0000

Machine learning algorithms have existed for decades. But in the last ten years, several advancements in software and hardware have caused dramatic growth in the viability of applications based on machine learning. Smartphones generate large quantities of data about how humans move through the world. Software-as-a-service companies generate data about how these humans interact with

The post Practical AI with Chris Benson appeared first on Software Engineering Daily.

Linkerd Market Strategy with William Morgan

Fri, 06 Dec 2019 10:00:40 +0000

The container orchestration wars ended in 2016 with Kubernetes being the most popular open source tool for deploying and managing infrastructure. Since that time, most large enterprises have been implementing a “platform strategy” based around Kubernetes. A platform strategy is a plan for creating a consistent experience for software engineers working throughout an enterprise. At

The post Linkerd Market Strategy with William Morgan appeared first on Software Engineering Daily.

Istio Market Strategy with Zack Butcher

Thu, 05 Dec 2019 10:00:39 +0000

Kubernetes has created a widespread system for deploying and managing infrastructure. As Kubernetes has been increasingly adopted, companies are thinking about how to leverage that common layer of infrastructure. With the common infrastructure abstraction of Kubernetes, it becomes easier to adopt other abstractions that are uniform across the entire company. This has created a market

The post Istio Market Strategy with Zack Butcher appeared first on Software Engineering Daily.

Heroku Infrastructure with Mark Turner

Wed, 04 Dec 2019 10:00:38 +0000

A cloud provider gives a developer low-cost compute infrastructure on-demand. Cloud providers can be divided up into two categories: Layer 1 cloud providers and Layer 2 cloud providers. A Layer 1 cloud provider such as Amazon Web Services owns server hardware and sells compute infrastructure as a commodity. A Layer 2 cloud provider purchases compute

The post Heroku Infrastructure with Mark Turner appeared first on Software Engineering Daily.

Java 13 with Georges Saab

Tue, 03 Dec 2019 10:00:39 +0000

Java has been popular since the 90s, when it started to be used as a programming language for enterprises. Today, Java is still widely deployed, but the infrastructure environment is dramatically different. Java is often deployed to containers in the cloud. If those containers can share resources, then those containers can share the same underlying

The post Java 13 with Georges Saab appeared first on Software Engineering Daily.

Distributed SQL with Karthik Ranganathan and Sidharth Choudhury

Mon, 02 Dec 2019 10:00:37 +0000

Relational databases provide durable transactional systems for storing data. The relational model has existed for decades, but the requirements for a relational database have changed. Modern applications have requirements for high volumes of data that do not fit onto a single machine. When a database gets too big to fit on a single machine, that

The post Distributed SQL with Karthik Ranganathan and Sidharth Choudhury appeared first on Software Engineering Daily.

Economics of Software with Russ Roberts Holiday Repeat

Fri, 29 Nov 2019 10:00:29 +0000

Originally published July 14, 2016 EconTalk is a weekly economics podcast that has been going for a decade. On EconTalk, Russ Roberts brings on writers, intellectuals, and entrepreneurs for engaging conversations about the world as seen through the lens of economics. Russ Roberts is today’s guest, and it is a treat because I have been

The post Economics of Software with Russ Roberts Holiday Repeat appeared first on Software Engineering Daily.

Uber’s Data Platform with Zhenxiao Luo Holiday Repeat

Thu, 28 Nov 2019 10:00:52 +0000

Originally published May 24, 2018 When a user takes a ride on Uber, the app on the user’s phone is communicating with Uber’s backend infrastructure, which is writing to a database that maintains the state of that user’s activity. This database is known as a transactional database or “OLTP” (online transaction processing). Every active user

The post Uber’s Data Platform with Zhenxiao Luo Holiday Repeat appeared first on Software Engineering Daily.

Kong API Platform with Marco Palladino Holiday Repeat

Wed, 27 Nov 2019 10:00:01 +0000

Originally published January 4, 2019 When a user makes a request to product like The New York Times, that request hits an API gateway. An API gateway is the entry point for an external request. An API gateway serves several purposes: authentication, security, routing, load balancing, and logging. API gateways have grown in popularity as

The post Kong API Platform with Marco Palladino Holiday Repeat appeared first on Software Engineering Daily.

Future of Computing with John Hennessy Holiday Repeat

Tue, 26 Nov 2019 10:00:58 +0000

Originally published June 7, 2018 Moore’s Law states that the number of transistors in a dense integrated circuit doubles about every two years. Moore’s Law is less like a “law” and more like an observation or a prediction. Moore’s Law is ending. We can no longer fit an increasing amount of transistors in the same

The post Future of Computing with John Hennessy Holiday Repeat appeared first on Software Engineering Daily.

Indie Hackers with Courtland Allen Holiday Repeat

Mon, 25 Nov 2019 10:00:52 +0000

Originally published November 4, 2016 Indie Hackers is a website that profiles independent developers who have made profitable software projects, usually without raising any money. These projects make anywhere from a few hundred dollars a month to more than $100,000 as in the case with park.io, one of the services profiled by Indie Hackers. Courtland

The post Indie Hackers with Courtland Allen Holiday Repeat appeared first on Software Engineering Daily.

Cloud Dependencies with Mya Pitzeruse

Sat, 23 Nov 2019 10:00:13 +0000

New software abstractions always take advantage of the abstractions that have been built before. Software libraries allow us to import code that sits on the same host as a new program. Open source software let us copy and paste existing code, or clone entire repositories. Cloud providers offer hosted tools and APIs that we can

The post Cloud Dependencies with Mya Pitzeruse appeared first on Software Engineering Daily.

Web Application Testing with Gabriel-James Safar

Fri, 22 Nov 2019 10:00:22 +0000

Web applications are used on a wide variety of platforms. On each of these platforms the web app needs to load properly and allow the user to navigate the website and interact with all of the user flows, such as sign-up, login, and the various read and write operations that make up the functionality of

The post Web Application Testing with Gabriel-James Safar appeared first on Software Engineering Daily.

HTTP with Julia Evans

Thu, 21 Nov 2019 10:00:21 +0000

HTTP is a protocol that allows browsers and web applications to communicate across the Internet. Everyone knows that HTTP is doing some important work, because “HTTP” is at the beginning of most URLs that you enter into your browser. You might be familiar with the request/response model, and HTTP request methods such as GET, PUT,

The post HTTP with Julia Evans appeared first on Software Engineering Daily.

Indie Hack or Venture Back with Lynne Tye

Wed, 20 Nov 2019 10:00:19 +0000

Key Values is a platform where companies are profiled with descriptions of their company values. These profiles describe features such as work-life balance, company culture, daily routines, and strategy. Lynne Tye created Key Values with the goal of building a small business that would make money through connecting job seekers to companies with a culture

The post Indie Hack or Venture Back with Lynne Tye appeared first on Software Engineering Daily.

Bubble: Code-Free Programming with Emmanuel Straschnov and Joshua Haas

Tue, 19 Nov 2019 10:00:02 +0000

The vision of code-free programming has existed for decades. Software engineers have always dreamed of empowering non-technical users with the same creative tools that programmers have access to. For many years, the underlying technology of the web was not powerful enough to make this dream a reality. Platforms such as WordPress, Squarespace, and Wix have

The post Bubble: Code-Free Programming with Emmanuel Straschnov and Joshua Haas appeared first on Software Engineering Daily.

Cloudflare Serverless with Zack Bloom

Mon, 18 Nov 2019 10:00:02 +0000

“Serverless” is an execution model where applications are scheduled and deployed to servers that are not directly managed by the application developer. In serverless execution, an application only loads and operates when a user actually needs to get a response from that application. This saves on resources, because many applications do not need to run

The post Cloudflare Serverless with Zack Bloom appeared first on Software Engineering Daily.

Dagster with Nick Schrock

Fri, 15 Nov 2019 10:00:09 +0000

Data engineering is difficult. Companies want to be able to maximize the value they get from their large data sets, but there are so many steps required for deriving that value that most companies feel like they are always far behind the ideal state of where they could be. The cloud makes it cheap to

The post Dagster with Nick Schrock appeared first on Software Engineering Daily.

GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard

Thu, 14 Nov 2019 10:00:58 +0000

Java programs run in a different environment than they did ten years ago. Modern infrastructure runs on containers sitting in a Kubernetes cluster. The optimal configuration for a Java program in that context is different than it was for an environment dominated by virtual machines and bare metal. When you are co-scheduling your services with

The post GraalVM Quarkus: Java Acceleration with Guillaume Smet and Emmanuel Bernard appeared first on Software Engineering Daily.

Bugsnag Business with James Smith

Wed, 13 Nov 2019 10:00:57 +0000

Crash monitoring emerged as a software category over the last decade. Crash monitoring software allows developers to understand when their applications are crashing on client devices. For example, we have an app for Software Engineering Daily that people download on Android or iOS. Users download the app to their smartphone. When the user is playing

The post Bugsnag Business with James Smith appeared first on Software Engineering Daily.

Incident Response Machine Learning with Chris Riley

Tue, 12 Nov 2019 10:00:56 +0000

Software bugs cause unexpected problems at every company. Some problems are small. A website goes down in the middle of the night, and the outage triggers a phone call to an engineer who has to wake up and fix the problem. Other problems can be significantly larger. When a major problem occurs, it can cause

The post Incident Response Machine Learning with Chris Riley appeared first on Software Engineering Daily.

Gatsby with Kyle Mathews and Sam Bhagwat

Mon, 11 Nov 2019 10:00:15 +0000

Frontend software development has become as complex as backend development. There was a time when frontend web development was simple. There was a small number of JavaScript frameworks and templating systems. Your CSS was simple configuration for the colors on your webpage. Today, there is a giant ecosystem of frontend tools, APIs, and middleware delivering

The post Gatsby with Kyle Mathews and Sam Bhagwat appeared first on Software Engineering Daily.

Drones with Chris Anderson

Fri, 08 Nov 2019 10:00:32 +0000

Drones will deliver food to us. Drones will be able to extinguish fires. Drones will be used to relay Internet signals and make the world more connected. These all sound like great ideas, so why aren’t there more drones in the sky today? There are many answers to that question, some of which relate to

The post Drones with Chris Anderson appeared first on Software Engineering Daily.

LinkedIn Data Engineering with Kapil Surlaker

Thu, 07 Nov 2019 10:00:51 +0000

A large social network needs to develop systems for ingesting, storing, and processing large volumes of data. Data engineering at scale requires multiple engineering teams that are responsible for different areas of the infrastructure. Data needs to be structured coherently in order to minimize the data cleaning process. Machine learning models need to be developed,

The post LinkedIn Data Engineering with Kapil Surlaker appeared first on Software Engineering Daily.

FOSSA: Open Source Management with Kevin Wang

Wed, 06 Nov 2019 10:00:52 +0000

Every company has a software supply chain. A company builds its products from custom code, paid APIs, paid proprietary binaries, and open source software libraries. As the types of software available have increased, the management of the software supply chain has become complex. Large software companies have always needed to ensure the security of their

The post FOSSA: Open Source Management with Kevin Wang appeared first on Software Engineering Daily.

Scale with Alexandr Wang

Tue, 05 Nov 2019 10:00:14 +0000

Machine learning is widely understood by the software community. But it is still hard to build a company around machine learning, because there is not easy access to large, unique data sets. Scale is a platform for training and validating data that is used for machine learning. Most machine learning models are built with supervised

The post Scale with Alexandr Wang appeared first on Software Engineering Daily.

Leadership with Ben Horowitz

Mon, 04 Nov 2019 11:05:50 +0000

Photo credit: Elisabeth Fall Ben Horowitz started Loudcloud with Marc Andreessen in 1999. He ran the company for eight years and chronicled his experience in his first book The Hard Thing About Hard Things. In his time running Loudcloud, the dotcom bubble burst, but Loudcloud needed cash so badly that he took the company public

The post Leadership with Ben Horowitz appeared first on Software Engineering Daily.

Facebook Leadership with Arturo Bejar

Fri, 01 Nov 2019 09:00:09 +0000

Facebook leadership has a significant amount of engineers in its ranks, and engineers understand how to create an environment that appeals to other engineers. Engineers do not like working on projects that they are not interested in, so Facebook optimizes for matching engineers to enjoyable work. Engineers do not like taking orders from managers, so

The post Facebook Leadership with Arturo Bejar appeared first on Software Engineering Daily.

Facebook Fallout with Antonio Garcia Martinez

Thu, 31 Oct 2019 09:00:07 +0000

Chaos Monkeys is a book about Silicon Valley startups and Facebook. It is one of the most accurate books written about the modern technology industry, and captures both the negatives and the positives of software companies. Antonio Garcia Martinez is the author of Chaos Monkeys. He wrote the book after going through a gauntlet of

The post Facebook Fallout with Antonio Garcia Martinez appeared first on Software Engineering Daily.

Facebook Reflections with Pete Hunt and Nick Schrock

Wed, 30 Oct 2019 09:00:53 +0000

Facebook engineering is unique. Software is built at Facebook in a way that is distinctly different than any other company. In our series of shows about Facebook engineering, we have mostly covered the positive side of Facebook’s practices. In today’s show, we explore the downsides. Facebook moves fast. Engineers within the company must move fast,

The post Facebook Reflections with Pete Hunt and Nick Schrock appeared first on Software Engineering Daily.

Facebook Products with Peter Deng

Tue, 29 Oct 2019 09:00:52 +0000

Peter Deng has worked on most of Facebook’s major products: Newsfeed, Instagram, Oculus, and Messenger. These different products have different requirements, but are all part of the same ethos of connecting people through social networks. Facebook is a consumer product company that is powered by a strong engineering workforce. The relationship between product managers and

The post Facebook Products with Peter Deng appeared first on Software Engineering Daily.

Facebook Entrepreneurship with Jeff Rothschild

Mon, 28 Oct 2019 09:00:45 +0000

Jeff Rothschild was one of the earliest engineers to join Facebook. In the 1990s, Jeff had co-founded Veritas Software and helped it to its IPO in 2004. After Veritas, Jeff worked on several other of his own companies. He was working with Accel Partners on investments when he started to learn about Facebook. Accel was

The post Facebook Entrepreneurship with Jeff Rothschild appeared first on Software Engineering Daily.

Alluxio: Data Orchestration with Haoyuan Li

Fri, 25 Oct 2019 09:00:49 +0000

In 2013, the Berkeley AMPLab was a center of innovation. Three projects from AMPLab have turned into successful open source projects and companies: Spark, Mesos, and Alluxio. Haoyuan Li was the creator of Alluxio, and he returns to the show to discuss his journey taking Alluxio from a research project to a company that has

The post Alluxio: Data Orchestration with Haoyuan Li appeared first on Software Engineering Daily.

Redis with Alvin Richards

Thu, 24 Oct 2019 09:00:12 +0000

Redis is an in-memory database that persists to disk. Redis is commonly used as an object cache for web applications. Applications are composed of caches and databases. A cache typically stores the data in memory, and a database typically stores the data on disk. Memory has significantly faster access times, but is more expensive and

The post Redis with Alvin Richards appeared first on Software Engineering Daily.

LinkedIn Data Platform with Carl Steinbach

Wed, 23 Oct 2019 09:00:50 +0000

LinkedIn is a social network with petabytes of data. In order to store that data, LinkedIn distributes and replicates that data across a large cluster of machines running the Hadoop Distributed File System. In order to run calculations across its large data set, LinkedIn needs to split the computation up using MapReduce-style jobs. LinkedIn has

The post LinkedIn Data Platform with Carl Steinbach appeared first on Software Engineering Daily.

Crypto Businesses with Haseeb Qureshi

Tue, 22 Oct 2019 09:00:25 +0000

Cryptocurrencies are a fundamental computer science invention. Cryptocurrencies crashed in 2018 but the technology remains as promising as ever. Bitcoin is a decentralized currency, and a plausible end state that is implied by Bitcoin’s current trajectory is a permissionless, decentralized financial system. This idea of decentralized finance or “DeFi” begs numerous questions: who will build

The post Crypto Businesses with Haseeb Qureshi appeared first on Software Engineering Daily.

Dark Lang with Ellen Chisa and Paul Biggar

Mon, 21 Oct 2019 09:00:01 +0000

Dark Lang is a programming language that is tightly integrated with the cloud. Dark takes an opinionated approach that most developers are going to want to run their applications in the cloud, and this perspective influences how Dark looks at deployments, IDEs, exception handling, and other aspects of software development. Paul Biggar is the founder

The post Dark Lang with Ellen Chisa and Paul Biggar appeared first on Software Engineering Daily.

LinkedIn Kafka with Nacho Solis

Fri, 18 Oct 2019 09:00:00 +0000

Apache Kafka was created at LinkedIn. Kafka was open sourced in 2011, when the company was eight years old. By that time, LinkedIn had developed a social network with millions of users. LinkedIn’s engineering team was building a range of externally facing products and internal tools, and many of these tools required a high-throughput system

The post LinkedIn Kafka with Nacho Solis appeared first on Software Engineering Daily.

Gravity: Distributed Application Delivery with Ev Kontsevoy

Thu, 17 Oct 2019 09:00:59 +0000

Modern applications are distributed systems. These applications require an installation mechanism that can run and update the software across multiple nodes. When a SaaS company starts to work with large enterprise customers, that company needs to figure out a way to deliver their product to the enterprise. This requires the SaaS company to deploy the

The post Gravity: Distributed Application Delivery with Ev Kontsevoy appeared first on Software Engineering Daily.

Incident Reproduction with Tammy Butow

Wed, 16 Oct 2019 09:00:58 +0000

Databases go offline. Services fail to scale up. Deployment errors can cause an application backend to get DDoS’d. When an event happens that prevents your company from operating as expected, it is known as an incident. Software teams respond to an incident by issuing a fix. Sometimes that fix returns the software to its ideal

The post Incident Reproduction with Tammy Butow appeared first on Software Engineering Daily.

Diffbot Infrastructure with Mike Tung

Tue, 15 Oct 2019 09:00:57 +0000

Diffbot is a knowledge graph that allows developers to interface with the unstructured web as if it was a structured database. In today’s show, Diffbot CEO Mike Tung returns for a second discussion about how he has built Diffbot and how Diffbot is used. The web has many different entities. Web pages, topics, people, stories,

The post Diffbot Infrastructure with Mike Tung appeared first on Software Engineering Daily.

How To Build A Cloud Provider with Anurag Goel

Mon, 14 Oct 2019 09:00:04 +0000

Render is a cloud provider built on top of Amazon Web Services and Google Cloud. Render uses the compute abstractions provided by the major cloud providers to build a second layer cloud provider with the goal of providing a better user experience. Anurag Goel is the founder of Render, and he returns to the show

The post How To Build A Cloud Provider with Anurag Goel appeared first on Software Engineering Daily.

freeCodeCamp’s Quincy Larson interviews Jeff Meyerson

Sat, 12 Oct 2019 09:00:02 +0000

We are republishing a podcast from the freeCodeCamp Podcast as a weekend episode. Jeff Meyerson is the creator and host of the Software Engineering Daily podcast. Jeff grew up in Texas. He spent most of his childhood playing competitive strategy games like Magic: the Gathering. This lead him to making a lot of money –

The post freeCodeCamp’s Quincy Larson interviews Jeff Meyerson appeared first on Software Engineering Daily.

Webflow: No-Code with Vlad Magdalin

Fri, 11 Oct 2019 09:00:03 +0000

Webflow is a platform for building applications without programming. Software engineering has barely been around for 30 years. Over that period of time, there have been many attempts to create a platform that allows for the creation of software without writing a line of code. Most of these systems have not been able to fulfill

The post Webflow: No-Code with Vlad Magdalin appeared first on Software Engineering Daily.

Data Visualization with Sherman Wood and Chad Lumley

Thu, 10 Oct 2019 09:00:01 +0000

Data visualization is the presentation of data in a way that emphasizes certain qualities about that data. Data visualization can be used to prove a specific point, or it can be used as a depiction of a data set to be explored. Data visualization is used in consumer software products as well as backend engineering

The post Data Visualization with Sherman Wood and Chad Lumley appeared first on Software Engineering Daily.

Treehouse: Business and Education with Ryan Carson

Wed, 09 Oct 2019 09:00:02 +0000

The ability to create software is a superpower. But software education is not evenly distributed. Ryan Carson started Treehouse to provide a high quality education system for anyone to learn how to build software. On a previous episode, Ryan and I discussed the field of programming education. Ryan returns to the show for a conversation

The post Treehouse: Business and Education with Ryan Carson appeared first on Software Engineering Daily.

Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh

Tue, 08 Oct 2019 09:00:00 +0000

Video surveillance impacts human lives every day. On most days, we do not feel the impact of video surveillance. But the effects of video surveillance have tremendous potential. It can be used to solve crimes and find missing children. It can be used to intimidate journalists and empower dictators. Like any piece of technology, video

The post Traces: Video Recognition with Veronica Yurchuk and Kostyantyn Shysh appeared first on Software Engineering Daily.

GDPR in Practice with Joshua Prismon

Mon, 07 Oct 2019 09:00:59 +0000

Data privacy policies have changed how software organizations need to operate. As consumer preferences have shifted in favor of strong privacy, software companies are having to examine their policies around data collection and retention. Many software companies were started in a time with different norms around data. Building a new application that is compliant with

The post GDPR in Practice with Joshua Prismon appeared first on Software Engineering Daily.

Indie Hackers (3 Years Later) with Courtland Allen

Fri, 04 Oct 2019 09:00:34 +0000

Indie Hackers is a platform for independent software businesses to discuss strategy and find inspiration. Courtland Allen founded Indie Hackers with the goal of sharing the stories of these businesses, and the company has become a thriving community of entrepreneurs, engineers, and creators. Business is a creative medium. The definition of a successful business is

The post Indie Hackers (3 Years Later) with Courtland Allen appeared first on Software Engineering Daily.

The Messy Middle with Scott Belsky

Thu, 03 Oct 2019 09:00:33 +0000

Scott Belsky founded Behance in 2006. Behance is a social platform where designers and creators share their work. Scott was motivated to start Behance due to his desire to combine his love for creativity with his desire to create a business. After 6 years of work, Behance was acquired by Adobe for more than $150

The post The Messy Middle with Scott Belsky appeared first on Software Engineering Daily.

Fivetran: Data Connectors with George Fraser

Wed, 02 Oct 2019 09:00:34 +0000

Large companies have multiple databases, multiple data formats, and multiple applications that need to use the data. Every data engineer needs to move data between these different components of a system. Moving data between different parts of a system is often called “ETL”, an acronym for “Extract, Transform, Load.” Data engineers spend much of their

The post Fivetran: Data Connectors with George Fraser appeared first on Software Engineering Daily.

Cruise: Self-Driving Engineering with Mo Elshenawy

Tue, 01 Oct 2019 09:00:38 +0000

The development of self-driving cars is one of the biggest technological changes that is under way. Across the world, thousands of engineers are working on developing self-driving cars. Although it still seems far away, self-driving cars are starting to feel like an inevitability. This is especially true if you spend much time in downtown San

The post Cruise: Self-Driving Engineering with Mo Elshenawy appeared first on Software Engineering Daily.

Software Moats with Astasia Myers

Mon, 30 Sep 2019 09:00:08 +0000

Investors often use the term “moat” to describe the durable competitive advantage of a company. When an investor puts money into a company, they are making that investment based on a valuation. That valuation is subjective–it is how much the investor thinks the company is worth. A valuation is determined by the present value of

The post Software Moats with Astasia Myers appeared first on Software Engineering Daily.

Stripe Infrastructure Management with Uma Chingunde

Fri, 27 Sep 2019 09:00:09 +0000

Software engineering is a new field. There are theories about how we should be building our systems, but these theories might change over time. The same is true for engineering management. There are many successful examples of companies scaling with the management hierarchies pioneered by Microsoft and Google, but since everyone knows that those techniques

The post Stripe Infrastructure Management with Uma Chingunde appeared first on Software Engineering Daily.

Life Insurance Engineering with Vipul Sharma and Lingke Wang

Thu, 26 Sep 2019 09:00:40 +0000

Ethos Life Insurance is a software company that sells life insurance products. Software is reshaping established industries such as banking, insurance, and manufacturing. In these large, established industries, incumbents are adopting new technology as fast as they can, but the new technology needs to be integrated with the old technology. The slow rate of technology

The post Life Insurance Engineering with Vipul Sharma and Lingke Wang appeared first on Software Engineering Daily.

WebAssembly Isolation with Tyler McMullen

Wed, 25 Sep 2019 09:00:37 +0000

Isolation is a fundamental concept in computer science. Software workloads are isolated from each other in order to keep resource access cleanly separated. When programs are properly isolated, it is easier for the programmer to reason about the memory safety of that program. When a program is not properly isolated, it can lead problems such

The post WebAssembly Isolation with Tyler McMullen appeared first on Software Engineering Daily.

Cloud Foundry with Abby Kearns

Tue, 24 Sep 2019 09:00:36 +0000

Cloud Foundry is a system for managing distributed applications. Cloud Foundry was released in 2011, and has been widely adopted by enterprises that need a platform for deploying and scaling the applications that run within their company. The ecosystem around Cloud Foundry includes systems for continuous delivery, pubsub messaging, and containerization. Abby Kearns is the

The post Cloud Foundry with Abby Kearns appeared first on Software Engineering Daily.

Kafka Data Pipelines with Robin Moffatt

Mon, 23 Sep 2019 09:00:57 +0000

A new software product usually starts with a single database. That database manages the tables for user accounts and basic transactions. When a product becomes popular, the database grows in size. There are more transactions and more users. A company grows around that product, and the company starts to accumulate more data in different sources.

The post Kafka Data Pipelines with Robin Moffatt appeared first on Software Engineering Daily.

ReadMe with Greg Koberger

Fri, 20 Sep 2019 09:00:22 +0000

A software company needs to get many things right in order to be successful. Having a useful product with solid engineering is only the beginning. ReadMe was started five years ago. The company solved a seemingly simple problem: documentation for software products. If you have worked as a software engineer, you have looked at documentation.

The post ReadMe with Greg Koberger appeared first on Software Engineering Daily.

Open Source Ecosystem with Dirk Hohndel

Thu, 19 Sep 2019 09:00:21 +0000

Open source software is very new. Open source has existed for less than 30-40 years, depending on who you ask. The idea of open source was popularized by Linux, and open source software started to get heavily commercialized in the 1990s. By the early 2000s, open source was used by nearly every large software company.

The post Open Source Ecosystem with Dirk Hohndel appeared first on Software Engineering Daily.

Distributed Databases with Aly Cabral

Wed, 18 Sep 2019 09:00:19 +0000

Modern databases consist of multiple servers that host the data in a distributed fashion. Using multiple servers allows a database to be resilient to the failure of any one database node, because copies of the data are shared to other servers. A multi-node setup also lets the database grow beyond the size of data that

The post Distributed Databases with Aly Cabral appeared first on Software Engineering Daily.

Kafka Applications with Tim Berglund

Tue, 17 Sep 2019 09:00:18 +0000

Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka allows information to flow throughout

The post Kafka Applications with Tim Berglund appeared first on Software Engineering Daily.

Okta Engineering with Hector Aguilar

Mon, 16 Sep 2019 09:00:17 +0000

A new employee at a software company needs access to a variety of tools. In order to get started working, the employee might need Slack, email, Google Docs, and Amazon Web Services, and all of these require an account with a username and password. Setting up all of these accounts can be time consuming, because

The post Okta Engineering with Hector Aguilar appeared first on Software Engineering Daily.

Cloud-Native Applications with Cornelia Davis

Fri, 13 Sep 2019 09:00:32 +0000

Amazon Web Services first came out in 2006. It took several years before the software industry realized that cloud computing was a transformative piece of technology. Initially, the common perspective around cloud computing was that it was a useful tool for startups, but would not be a smart option for large, established businesses. Cloud computing

The post Cloud-Native Applications with Cornelia Davis appeared first on Software Engineering Daily.

Talking Python with Michael Kennedy

Thu, 12 Sep 2019 09:00:30 +0000

Python is one of the most popular programming languages in the software world. After working with Python and developing a love for the language, Michael Kennedy started to wonder why there was not a high quality podcast dedicated to covering the community and new technologies of the Python ecosystem. Michael started Talk Python To Me

The post Talking Python with Michael Kennedy appeared first on Software Engineering Daily.

MongoDB Data Platform with Andrew Davidson

Wed, 11 Sep 2019 09:00:29 +0000

A new software application has simple requirements for a database. The database needs to be written to and read from. The database fulfills simple needs such as storing user information and providing the application frontend with the necessary data to render a simple webpage of financial transactions or blog posts. As an application becomes successful,

The post MongoDB Data Platform with Andrew Davidson appeared first on Software Engineering Daily.

Google Spanner with Deepti Srivastava

Tue, 10 Sep 2019 09:00:28 +0000

Spanner is a globally distributed, transactionally consistent database. Spanner initially emerged as a paper that came out of Google in 2012. Around this time, database scalability was difficult to solve, even for Google. The Spanner paper offered some breakthroughs in distributed systems which allowed Google to take some of the learnings from BigTable’s eventual consistency

The post Google Spanner with Deepti Srivastava appeared first on Software Engineering Daily.

Open Source Policy with Bruce Perens

Mon, 09 Sep 2019 09:00:53 +0000

Open source plays a key role in today’s world of technology businesses. Today, the impact of open source seems obvious. From Kubernetes to distributed databases to cloud providers, so much of our software is powered by open source. But it was not always this way. Bruce Perens was one of the earliest figures in the

The post Open Source Policy with Bruce Perens appeared first on Software Engineering Daily.

JavaScript Jabber with Jeff Meyerson

Sun, 08 Sep 2019 09:00:59 +0000

Host: Charles Max Wood of JavaScript Jabber Joined by Special Guest: Jeffrey Meyerson Jeffrey Meyerson, founder of FindCollabs and host at Software Engineering Daily joins Charles Max Wood for a discussion about latest trends in the developer world, ways of monetizing podcasts, and finding ads for podcasts. Jeffrey shares how he started to host podcasts and how he became

The post JavaScript Jabber with Jeff Meyerson appeared first on Software Engineering Daily.

Repl.it: Browser Coding with Amjad Masad

Fri, 06 Sep 2019 09:00:02 +0000

The browser has become the central application of the consumer operating system. Every piece of client software, from email to document management, has become usable through the browser. Even modern desktop software such as Slack is built using Electron, a tool for building client applications that essentially run inside of a browser without an address

The post Repl.it: Browser Coding with Amjad Masad appeared first on Software Engineering Daily.

Monday: Business Management Software with Eran Zinman

Thu, 05 Sep 2019 09:00:01 +0000

Modern software is built with cloud services, APIs, and other high level tools. Technical software development is moving beyond the realm of writing code. Individuals who do not have a background in computer science or programming can create increasingly complex tools. Higher level APIs include Twilio for managing phone communications, and Stripe for managing financial

The post Monday: Business Management Software with Eran Zinman appeared first on Software Engineering Daily.

Cassandra Business with Jonathan Ellis

Wed, 04 Sep 2019 09:00:00 +0000

Cassandra was initially released in 2008 as a project out of Facebook. Cassandra offered an open source solution to database scalability issues that were being tackled internally by large companies like Amazon, Google and Facebook. 2008 was a golden age of new infrastructure, with systems such as Hadoop and Kafka gaining traction around the same

The post Cassandra Business with Jonathan Ellis appeared first on Software Engineering Daily.

DevOps at Delta Air Lines with Jasmine James

Tue, 03 Sep 2019 09:00:58 +0000

Airlines have always had an emphasis on new technology. Over the years, airlines have needed to develop more and more software. Digital transformation is causing every large company to adopt the tools and practices of software companies, and that includes Delta Airlines. Delta Airlines has existed for more than 90 years. Over that period of

The post DevOps at Delta Air Lines with Jasmine James appeared first on Software Engineering Daily.

Facebook Parse Acquisition (Part 2) with Ilya Sukhar

Fri, 30 Aug 2019 09:00:02 +0000

Ilya Sukhar founded Parse in 2011 to make cloud services for mobile developers. Parse was a newer kind of cloud provider called “backend-as-a-service”, built to simplify the complexities of Amazon Web Services and the complexities of the mobile ecosystem. During this time, Facebook was in the middle of its shift toward becoming a mobile application

The post Facebook Parse Acquisition (Part 2) with Ilya Sukhar appeared first on Software Engineering Daily.

Facebook Parse Acquisition (Part 1) with Charity Majors

Thu, 29 Aug 2019 09:00:01 +0000

Parse was a backend-as-a-service company that started in 2011 with the initial focus of making the cloud easier to use for mobile developers. Parse had several novel engineering challenges. In 2011, it was not easy to build on top of AWS, nor was it easy to build within the young mobile ecosystem. Charity Majors was

The post Facebook Parse Acquisition (Part 1) with Charity Majors appeared first on Software Engineering Daily.

Facebook Engineering Process with Kent Beck

Wed, 28 Aug 2019 09:00:59 +0000

Kent Beck is a legendary figure in the world of software engineering. Kent was an early advocate of Test-Driven Development (TDD), and popularized the idea of writing unit tests before writing code that would satisfy those unit tests. A unit test isolates and tests a small piece of functionality within a large piece of software.

The post Facebook Engineering Process with Kent Beck appeared first on Software Engineering Daily.

Facebook Release Engineering with Chuck Rossi

Tue, 27 Aug 2019 09:00:58 +0000

When Chuck Rossi joined Facebook in 2008, he was one of the most experienced release engineers at the company. As he began to explore the engineering practices of the organization, he was surprised, confused, and impressed by the release engineering system that he encountered. Release engineering is the process by which software is released to

The post Facebook Release Engineering with Chuck Rossi appeared first on Software Engineering Daily.

Facebook Scaling with Pedram Keyani

Mon, 26 Aug 2019 09:00:39 +0000

Facebook is a large multiuser application. Scaling Facebook was different than scaling a single-user application such as an ecommerce store or a search engine. A social network is faced with unique infrastructure scalability challenges, as well as subjective questions around user communications, privacy, and content. Pedram Keyani worked at Google before joining Facebook in 2007.

The post Facebook Scaling with Pedram Keyani appeared first on Software Engineering Daily.

Crypto and OSS with Haseeb Qureshi, Joseph Jacks, and Alok Vasudev

Fri, 23 Aug 2019 09:00:37 +0000

Cryptocurrencies are decentralized monetary systems built on open source software. The open source software movement has evolved from the world of Linux, MySQL, and Apache to a thriving ecosystem of commercial enterprises built around open source software. This ecosystem includes projects such as Kubernetes, MongoDB, and ReactJS. It includes large organizations such as Amazon Web

The post Crypto and OSS with Haseeb Qureshi, Joseph Jacks, and Alok Vasudev appeared first on Software Engineering Daily.

Technical Onboarding with Kristen Gallagher

Thu, 22 Aug 2019 09:00:35 +0000

When a new employee joins a software company, it is often unclear where that employee should begin. Do they have a mentor? What are they working on? What are the expectations for how fast that employee should be contributing? The early period of employment is often referred to as “onboarding.” During the onboarding period, an

The post Technical Onboarding with Kristen Gallagher appeared first on Software Engineering Daily.

Time Series Databases with Rob Skillington

Wed, 21 Aug 2019 09:00:34 +0000

A time series database is optimized for the storage of high volumes of sequential data across time. Time series databases are often organized as columnar data stores that can write large volumes of data quickly. These systems can sometimes tolerate data loss, because the data they are gathering is used for monitoring and other applications

The post Time Series Databases with Rob Skillington appeared first on Software Engineering Daily.

Insurance Software with Gordon Wintrob

Tue, 20 Aug 2019 09:00:32 +0000

Insurance is an old business. Individuals and businesses have been buying insurance policies for decades. These insurance policies can cost hundreds, thousands, or tens of thousands of dollars per year. Software is remaking the insurance industry. One way new software can improve the insurance industry is through better brokerage technology. Insurance involves carriers and brokers,

The post Insurance Software with Gordon Wintrob appeared first on Software Engineering Daily.

Open Source Business Models with Karthik Ranganathan, Heather Meeker, and Matt Asay

Mon, 19 Aug 2019 09:00:31 +0000

Open source software has evolved into a thriving, multifaceted ecosystem. Open source encompasses operating systems and databases. Open source embodies both altruism and self-interest. And open source enables thriving businesses from WordPress blogs to hundred billion dollar cloud providers. There is a large set of business models that can be built around a successful open

The post Open Source Business Models with Karthik Ranganathan, Heather Meeker, and Matt Asay appeared first on Software Engineering Daily.

Bitcoin Ecosystem with Andreas M. Antonopoulos

Fri, 16 Aug 2019 09:00:33 +0000

Andreas M. Antonopoulos is the author of several books about cryptocurrency engineering, including Mastering Bitcoin and Mastering Ethereum. In these books, Andreas lays out the systems of economics and computer science that underpin the two most mature decentralized monetary systems. When Andreas originally discovered the Bitcoin whitepaper, he had witnessed the repeated mismanagement of government-backed fiat

The post Bitcoin Ecosystem with Andreas M. Antonopoulos appeared first on Software Engineering Daily.

Moonlight: Software Contracting Platform with Emma Lawler and Philip Thomas

Thu, 15 Aug 2019 09:00:32 +0000

Software engineers often work as a contractor for some duration of their career. A contractor earns a fixed hourly salary for a defined period of weeks, months, or years. Contract work can be more flexible than full-time work, and often pays more than full-time software engineering, because contract jobs can end at any time, and

The post Moonlight: Software Contracting Platform with Emma Lawler and Philip Thomas appeared first on Software Engineering Daily.

Service Mesh Deployment with Varun Talwar

Wed, 14 Aug 2019 09:00:31 +0000

The service mesh abstraction allows for a consistent model for managing and monitoring the different components of a microservices architecture. In the service mesh pattern, each service is deployed with a sidecar container that contains a service proxy. These sidecars are collectively referred to as the “data plane.” Each sidecar provides the service that it

The post Service Mesh Deployment with Varun Talwar appeared first on Software Engineering Daily.

PlayStation Engineering with Tony Godar

Tue, 13 Aug 2019 09:00:30 +0000

The PlayStation is a line of game consoles created by Sony. PlayStation devices include the PS2, PS3, PS4, and the PSP mobile system. Tony Godar worked as an engineer in the PlayStation ecosystem for 15 years, and he joins the show to give a retrospective on his time in the console industry. Developing hardware and

The post PlayStation Engineering with Tony Godar appeared first on Software Engineering Daily.

Big Business with Tyler Cowen

Mon, 12 Aug 2019 11:50:54 +0000

Large software companies have become a target for criticism. Google, Facebook, Amazon and other prominent technology giants find themselves under a kind of scrutiny that is reminiscent of banks in 2008 and oil companies in the early 1900s. Across the planet, there is a growing sentiment that “big tech” has too much power, and that

The post Big Business with Tyler Cowen appeared first on Software Engineering Daily.

An Elegant Puzzle Virtual Book Club

Sun, 11 Aug 2019 09:00:59 +0000

In this episode Will Larson, author of An Elegant Puzzle: Systems of Engineering Management, speaks with Uma Chingunde of Stripe and Jeff Meyerson of Software Engineering Daily about engineering management. Will was also featured on SE Daily recently. An Elegant Puzzle is an excellent resource on management techniques and strategies for scaling software organizations. Will’s writing draws from

The post An Elegant Puzzle Virtual Book Club appeared first on Software Engineering Daily.

a16z Podcasting with Sonal Chokshi

Fri, 09 Aug 2019 21:19:58 +0000

The a16z Podcast is a show that is produced by Andreessen Horowitz, an investment fund based in Silicon Valley. The a16z Podcast covers topics including software engineering, biology, media, cryptocurrencies and entrepreneurship. A16z is one of the most popular podcasts about technology. Sonal Chokshi is the editor in chief at Andreessen Horowitz and the showrunner

The post a16z Podcasting with Sonal Chokshi appeared first on Software Engineering Daily.

Data-As-A-Service with Auren Hoffman

Thu, 08 Aug 2019 09:00:56 +0000

Data-as-a-service businesses offer paid access to data sets. These data sets can be useful for building products or training machine learning models. There has been steady growth in the tools and practices around processing and storing data. But access to data sets remains a bottleneck for widespread development of machine learning applications in a large

The post Data-As-A-Service with Auren Hoffman appeared first on Software Engineering Daily.

People.ai: Machine Learning for Sales with Andrey Akselrod

Wed, 07 Aug 2019 09:00:55 +0000

A large sales organization has hundreds of sales people. Each of those sales people manages a set of accounts who they are trying to close sales deals on. Sales people are overseen by managers who ensure that the sales people are performing well. Directors and VPs ensure the scalability and health of the overall sales

The post People.ai: Machine Learning for Sales with Andrey Akselrod appeared first on Software Engineering Daily.

Jaeger: Distributed Tracing at Uber with Yuri Shkuro

Tue, 06 Aug 2019 09:00:54 +0000

During 2015, Uber was going through rapid scalability. The internal engineering systems were constantly tested by the growing user base. Over the next two years, the number of internal services at Uber would grow from 500 to 2000, and standardizing the monitoring of all these different services became a priority. After working with a variety

The post Jaeger: Distributed Tracing at Uber with Yuri Shkuro appeared first on Software Engineering Daily.

Golden: Intelligent Knowledge Map with Jude Gomila

Mon, 05 Aug 2019 09:00:20 +0000

A knowledge base assembles information from a wide variety of sources into a central platform. The most popular knowledge base is Wikipedia, which covers a wide variety of concepts through a system that attempts to remain authoritative and impartial. Other open knowledge platforms include Stack Overflow, which focuses on programming concepts, and Quora, which adds

The post Golden: Intelligent Knowledge Map with Jude Gomila appeared first on Software Engineering Daily.

Career Karma: Coding Bootcamp Platform with Ruben Harris and Artur Meyster

Fri, 02 Aug 2019 10:56:31 +0000

Coding bootcamps allow anyone to become a programmer at a faster pace than the traditional computer science education system. In the last five years, coding bootcamps have grown rapidly in popularity, with thousands of people gaining the necessary skills to work as a software engineer. Career Karma is a platform that allows individuals to find

The post Career Karma: Coding Bootcamp Platform with Ruben Harris and Artur Meyster appeared first on Software Engineering Daily.

Hackathons with Jonathan Gottfried

Thu, 01 Aug 2019 10:00:30 +0000

A hackathon is an organized event where participants work together to build a product or tool. Hackathons are about creativity, learning, and exploration. A developer that is participating in a hackathon is often working on something that is outside of their normal day-to-day focus. Hackathons can provide significant value to the participants. Hackathons have led

The post Hackathons with Jonathan Gottfried appeared first on Software Engineering Daily.

TechPrimers: Software Engineering YouTube with Ajay Kumar

Wed, 31 Jul 2019 09:00:29 +0000

Videos play a key role in the continuing education of a software engineer. Video can capture many different types of content that is useful for engineers: conference talks, tutorial videos, and podcast-style interviews are all popular formats of online video. YouTube has become the predominant source for video content about software engineering. The open nature

The post TechPrimers: Software Engineering YouTube with Ajay Kumar appeared first on Software Engineering Daily.

WebAssembly on IoT with Jonathan Beri

Tue, 30 Jul 2019 09:00:28 +0000

“Internet of Things” is a term used to describe the increasing connectivity and intelligence of physical objects within our lives. IoT has manifested within enterprises under the term “Industrial IoT,” as wireless connectivity and machine learning have started to improve devices such as centrifuges, conveyor belts, and factory robotics. In the consumer space, IoT has

The post WebAssembly on IoT with Jonathan Beri appeared first on Software Engineering Daily.

Data Mesh with Zhamak Deghani

Mon, 29 Jul 2019 09:00:26 +0000

Data engineering involves numerous tools–a data lake, databases, data warehouses, numerous APIs, streaming systems, and microservices. There is no shortage of ways to interact with data and manage data, but many companies are struggling to figure out design patterns and best practices for how to manage data and build data infrastructure. Zhamak Dehgani is a

The post Data Mesh with Zhamak Deghani appeared first on Software Engineering Daily.

Software IPOs with Tomasz Tunguz

Fri, 26 Jul 2019 09:00:26 +0000

Software companies such as Slack, Zoom, and Uber have recently gone public. When a company goes public, they issue a document called an S-1. Within the S-1, there is a wealth of information about the company, providing a detailed story about the company’s business model, economics, and future prospects. The S-1 describes the operating model

The post Software IPOs with Tomasz Tunguz appeared first on Software Engineering Daily.

Envoy Mobile with Matt Klein

Thu, 25 Jul 2019 09:00:25 +0000

Envoy is an open source edge and service proxy that was originally developed at Lyft. Envoy is often deployed as a sidecar application that runs alongside a service and helps that service by providing features such as routing, rate limiting, telemetry, and security policy. Envoy has gained significant traction in the open source community, and

The post Envoy Mobile with Matt Klein appeared first on Software Engineering Daily.

TechLitAfrica: Computer Literacy in Africa with Tyler Cinnamon

Wed, 24 Jul 2019 09:00:30 +0000

In the developed world, it is easy to take for granted that we grew up with computers. Technology is so pervasive in the United States that we have debates about how early in child development a human should be given a smartphone. Across much of Africa, there is a shortage of access to computers. Children

The post TechLitAfrica: Computer Literacy in Africa with Tyler Cinnamon appeared first on Software Engineering Daily.

Data Engineering with Tobias Macey

Tue, 23 Jul 2019 09:00:45 +0000

The Hadoop ecosystem provided every company with the tools to store and query large amounts of data at a low cost. Since 2005, that ecosystem has expanded with more and more open source applications for data infrastructure. Data infrastructure includes databases, data lakes, distributed queues, data warehouses, query engines, web applications, on-prem software, closed source,

The post Data Engineering with Tobias Macey appeared first on Software Engineering Daily.

Emerging Markets: Vietnam with Charles Lee

Mon, 22 Jul 2019 09:00:44 +0000

From Africa to India to Asia to South America–computer science and programming are rising in popularity in every emerging market. Each of these markets has regional needs for technology. Just like every culture develops its own food and television, every culture needs different types of applications to run their lives. In Vietnam, the day-to-day life

The post Emerging Markets: Vietnam with Charles Lee appeared first on Software Engineering Daily.

Facebook GraphQL with Lee Byron

Fri, 19 Jul 2019 09:00:13 +0000

In 2011, Facebook had begun to focus its efforts on mobile development. Mobile phones did not have access to reliable, high bandwidth connections, and the Facebook engineering team needed to find a solution to improve the request latency between mobile clients and the backend Facebook infrastructure. One source of latency was recursive data fetching. If

The post Facebook GraphQL with Lee Byron appeared first on Software Engineering Daily.

Facebook Open Source Management with Tom Occhino

Thu, 18 Jul 2019 09:00:53 +0000

Facebook has released open source software projects that have changed the industry. The most impactful projects to date are the React frontend user interface tools: ReactJS and React Native. Before React became popular, there were multiple competing solutions for the dominant frontend JavaScript framework. React became the most prominent because of its invention of JSX,

The post Facebook Open Source Management with Tom Occhino appeared first on Software Engineering Daily.

Facebook Data Infrastructure with Dhruba Borthakur

Wed, 17 Jul 2019 09:00:29 +0000

Facebook generates high volumes of data at a rapid pace. Dhruba Borthakur joined Facebook in 2008 to work on data infrastructure. His early projects at Facebook were around Hadoop, the distributed file system and MapReduce computation platform that laid the foundation for the “big data” movement. At the time, Facebook was generating as much data

The post Facebook Data Infrastructure with Dhruba Borthakur appeared first on Software Engineering Daily.

Facebook Engineering Culture with Raylene Yung

Tue, 16 Jul 2019 09:00:20 +0000

Facebook moves fast because of vision, collaboration, and trust. The fast pace of development is enabled by constantly improving infrastructure and a sense of unity throughout the company. In Facebook’s early days, there was an emphasis on rapidly deploying new code to drive constant improvement and experimentation. Product quality was maintained by engineers closely checking

The post Facebook Engineering Culture with Raylene Yung appeared first on Software Engineering Daily.

Facebook PHP with Keith Adams

Mon, 15 Jul 2019 09:00:19 +0000

Facebook was built using PHP, a programming language that was used widely in the late 90s and early 2000s. PHP allows developers to get web applications built quickly and easily, although PHP has a reputation for being difficult to scale. In the early days of Facebook, the company was scaling rapidly on every dimension. New

The post Facebook PHP with Keith Adams appeared first on Software Engineering Daily.

Meltano: Data Engineering Lifecycle with Danielle Morrill

Fri, 12 Jul 2019 09:00:48 +0000

Data engineering allows a company to take advantage of the large quantities of data that the company has generated. In many companies, new data has been produced rapidly for many years, but the company has not been able to take full advantage of it. Creating large data sets does not provide immediate value for a

The post Meltano: Data Engineering Lifecycle with Danielle Morrill appeared first on Software Engineering Daily.

Software Media with Charles Max Wood

Thu, 11 Jul 2019 09:00:45 +0000

Software engineers have a wide variety of media to choose from, including podcasts, blogs, YouTube videos, conferences. The amount of software engineering media that is available is growing and accelerating. Eight years ago, there were not as many options for information about software. Charles Max Wood founded Devchat.tv to create a network of podcasts and

The post Software Media with Charles Max Wood appeared first on Software Engineering Daily.

gVisor Container Isolation with Michael Pratt and Yoshi Tamura

Wed, 10 Jul 2019 09:00:44 +0000

Software applications running within a host operating system need to be isolated. Isolation prevents security vulnerabilities, such as one application accessing the memory of another. In modern cloud environments, a single physical host might be running multiple virtual machines on top of a hypervisor. Those virtual machines might be divided up into containers. The different

The post gVisor Container Isolation with Michael Pratt and Yoshi Tamura appeared first on Software Engineering Daily.

Software Free Radicals with Lior Kanfi

Tue, 09 Jul 2019 09:00:45 +0000

Creating a software company has never been easier. Software engineers are increasingly seeing entrepreneurship as a viable career path. But the path to being an independent software developer is not always clear. Most engineers spend some of their career working at a software company. Even an engineer who intends to build a company someday can

The post Software Free Radicals with Lior Kanfi appeared first on Software Engineering Daily.

Edge Storage with Steve Klabnik

Mon, 08 Jul 2019 09:00:09 +0000

Edge computing allows for faster data access and computation. When your client application makes a request, that request might be routed to the edge. Edge servers are more numerous and more widely distributed than normal data centers, but an edge server might not have all of the data or the complete application logic for the

The post Edge Storage with Steve Klabnik appeared first on Software Engineering Daily.

You Are Not A Commodity (Keynote at Tikal Full Stack Tech Radar Day)

Sun, 07 Jul 2019 12:21:55 +0000

Today’s episode is a keynote I gave at Full Stack Tech Radar Day in Tel Aviv. The talk is called “You Are Not a Commodity”. This talk is also available as a YouTube video. The slides can be accessed here. The world of commodity engineering is coming to an end. Developers are becoming more productive,

The post You Are Not A Commodity (Keynote at Tikal Full Stack Tech Radar Day) appeared first on Software Engineering Daily.