Page 2 of 4

Sleek and Fast: Speeding Up your Fat Web Client

Once our RUM measurements and Session-weighted p90 were established so that we would know when we were at least as good as our existing site, we were almost ready to start the hard work of becoming sleek and fast.

Knowing …

Open-sourcing RacerD: Fast static race detection at scale

Concurrent programming is hard. It is difficult for humans to think about the vast number of potential interactions between processes, and this makes concurrent programs hard to get right in the first place. Further, concurrency errors are difficult to debug …

Mobile @Scale 2017 recap

Last week we capped off another year of @Scale events with Mobile@Scale 2017 in Boston. @Scale is an invitation-only technical conference focused on bringing people together to openly discuss the challenges of building software that serve millions or even billions …

Machine Learning Platform meetup

Recap of the Oct 2017 ML Platform meetup at Netflix HQ

By Faisal Siddiqi

Machine Learning is making fast inroads into many areas of business and is being employed in an increasingly widening array of commercial applications. At Netflix, ML …

FDA approved: U.S. Food and Drug Administration on Box

Today we’re excited to announce that the U.S. Food and Drug Administration (FDA) has selected our cloud content management platform to modernize its technical infrastructure and drive new ways to work in the cloud. With Box, the FDA is furthering …

From Power Calculations to P-Values: A/B Testing at Stack Overflow

Welcome to The Stack Overflow Podcast episode #119 recorded Thursday, October 12, 2017 at the Stack Overflow HQ in NYC. Today’s motley crew includes VP and GM of Stack Overflow…
Whether it’s your first position out of college or a …

Mitigating replication lag and reducing read load with freno

At GitHub, we use MySQL as the main database technology backing our services. We run classic MySQL master-replica setups, where writes go to the master, and replicas replay master’s changes asynchronously. To be able to serve our traffic we read …

Stretching Spokes

GitHub’s Spokes system stores multiple distributed copies of Git repositories. This article discusses how we got Spokes replication to span widely separated datacenters.

Background: Spokes

GitHub developed a system called Spokes to store multiple replicas of our users’ Git repositories …

Developer Experience Lessons Operating a Serverless-like Platform At Netflix — Part II

By Ludovic Galibert, Vasanth Asokan and Sangeeta Narayanan

In Part 1 of this series, we outlined key learnings the Edge Developer Experience team gained from operating the API dynamic scripting platform which provides a serverless or FaaS like experience …

Find solutions for your business with Box Platform Solutions Gallery

With Box Platform, we’ve helped hundreds of businesses bring our cloud content management capabilities to their own applications – using our APIs to build engaging digital experiences for their employees, customers, and partners. However even with more than a hundred …

Overheard on BoxWorks Day 1

If you aren’t in San Francisco with us at BoxWorks, or following the event via Box Live and Twitter, some of the things we heard are certainly worth talking about. From Aaron’s opening keynote to Dr. Jill Biden’s Box …

Evolution of GitHub’s data centers

Over the past 18 months we’ve made a significant investment in GitHub’s physical infrastructure. The goal of this work is to improve the redundancy and global availability of our system. In doing so we’ve solidified the foundation upon which we …

Transit and Peering: How your requests reach GitHub

GitHub is at a scale that provides exposure to interesting aspects of running a major site and are working to mature and level-up many parts of our infrastructure as we grow. One of the areas where this is evident is …

Streaming Data Pipelines with Brooklin

Datastream management API
This is a REST endpoint to create, update, manage, or delete datastream objects. It stores datastream objects in Zookeeper. At LinkedIn, we have a self-service portal called Nuage that facilitates creating and managing infrastructure resources, including Brooklin.…

Box using Azure: accelerating digital transformation with Microsoft

In June, we announced that Box and Microsoft are expanding their partnership and will jointly offer Box cloud content management using Microsoft Azure services. Today, we’re thrilled to announce Box using Azure, the first offering from this partnership which delivers …

Intelligence in Box: Smarter content means smarter ways to work

More data will be created in 2017 than in the last 5,000 years combined. The digital age has brought with it a proliferation of new platforms, applications and devices that are fueling this unprecedented creation of business content. In fact, …

The Impressive Growth of R

Welcome to The Stack Overflow Podcast episode #118 recorded Thursday, October 5 at Stack Overflow HQ in NYC. Even without Joel, who’s still out working on NamCoin, there’s still a…
According to the National Center for Women & Information Technology, …

Making collaboration more powerful with updates to Box

Since last BoxWorks, we’ve been heavily focused on improving the Box experience, building new products and features to provide a faster, easier way to work on Box.

This started with the new Files experience, where we redesigned our user interface …

Cross the workflow finish line with Box Relay

The phrase “work smarter, not harder” truly applies when it comes to increasing operational efficiencies. And one of the quickest ways to realize these efficiencies is to automate manual processes.

To help with this business challenge, we announced our foray …

Getting to Know David Max

Before joining LinkedIn in the New York City office in February 2015, he worked at Google on ad serving for about two years. Before that, he spent about 10 years working in financial technology for various financial firms, such as …

Congratulations to three inspiring women at Airbnb being recognized by the Women of Color in STEM…

At Airbnb, we value the diversity of our workforce, our guests, our hosts, and the world around us. Today, we’d like to congratulate three inspiring women who will be recognized as rising stars in their fields at the upcoming Women

5 reflections from Boxers volunteering abroad

This past summer, a few dedicated Boxers found themselves in the middle of Costa Rica, having volunteered to participate in Box’s service learning project with Team4Tech. This year, the team was tasked with the development of curriculum around several makerspace …

Meet Box’s Grace Hopper Speakers and WIT Sponsors!

This week, Box Engineering is excited to have over 25 Boxers participate in the annual Grace Hopper Celebration (GHC), the world’s largest gathering of women technologists. 10 of these Boxers will be conference speakers, covering a wide range of …

Where to find Higher Education peers at #BoxWorks

With hundreds of the world’s leading colleges and universities deploying Box, this year a record number of higher education community members will be attending Boxworks. There’s a packed agenda full of incredible announcements, updates, and stories from customers and partners …

Health Score Metrics as a Software Craftsmanship Enabler

The notion of software craftsmanship is sometimes a muddy one. On the one hand, engineers find it hard to grasp and materialize craftsmanship, which is an abstract objective that, by itself, provides little guidance to the software engineering practice. On …

Welcoming Our BoxWorks ’17 Partner Sponsors

In the digital age, every part of business and work is changing — how you collaborate, manage information, build apps and even power your business processes is all completely different today. BoxWorks is where you find out how to lead …

Serving 100 Gbps from an Open Connect Appliance

By Drew Gallatin

In the summer of 2015, the Netflix Open Connect CDN team decided to take on an ambitious project. The goal was to leverage the new 100GbE network interface technology just coming to market in order to be …

Open Sourcing Our Women in Tech High School Trainee Program

2017 Trainees survive a Murder Mystery lunch together

The results of this program speak for themselves. Even this year, as we incorporated students who expressed less up-front interest in or exposure to technology, we continued to exceed our goals.

2015-2017

Content management strategy made simple at BoxWorks 2017

What’s on your mind? Would it happen to be … the future of work?  Cloud content management and strategy? Digital transformation? Gaining a competitive advantage?

Look no further, because we’ve got the scoop on all of that and more at …

Multithreaded rendering on Android with Litho and Infer

The types of content people share on News Feed have evolved from text, to photo, to video, to rich immersive experiences like 360 and Live. As these experiences become more sophisticated, it gets more challenging to render items on screen …

React 16: A look inside an API-compatible rewrite of our frontend UI library

React makes it simple to build functional, component-based user interfaces on web and mobile; at Facebook, we have more than 30,000 React components in our main web repo alone. React’s simplicity and functionality has led to its adoption by hundreds …

Preparing to Celebrate Women in Tech at GHC ’17

I’ve been in the technology industry for 17 years and consider my attendance at the Grace Hopper Celebration of Women in Computing as one of the most powerful experiences of my career—and one of the most fulfilling. I’m looking forward …

Relicensing the GraphQL specification

Today we’re relicensing the GraphQL specification under the Open Web Foundation Agreement (OWFa) v1.0. We think the OWFa is a great fit for GraphQL because it’s designed for collaborative open standards and supported by other well-known companies. The OWFa …

Going paperless: from vision to reality

Though going paper-free is often the starting point for a company’s digital transformation, far fewer organizations have taken advantage of newer automation and routing tools that could provide real operational gains. In fact, only 22% of organizations have moved to …

Migrating a database from InnoDB to MyRocks

Last year, we introduced MyRocks, our new MySQL database engine, with the goal of improving space and write efficiency beyond what was possible with compressed InnoDB. Our objective was to migrate one of our main databases (UDB) from compressed …

How You Can Use the New Stack Overflow Bot from Microsoft

According to the National Center for Women & Information Technology, only 26% of professional computing roles in the workforce in the US are held by women. Within prominent companies in the industry, the numbers…
On the data team here at …

Relicensing React, Jest, Flow, and Immutable.js

Next week, we are going to relicense our open source projects React, Jest, Flow, and Immutable.js under the MIT license. We’re relicensing these projects because React is the foundation of a broad ecosystem of open source software for the web, …

SLAM: Bringing art to life through technology

“To many, technology seems unapproachable. But through art, technology becomes more human and even an artistic medium in its own right.”

These are the words San Francisco artist Heather Day wrote in a proposal letter to Facebook, where she hoped …

Serving Top Comments in Professional Social Networks

For the purposes of comment relevance, we needed a serving subsystem that could satisfy the following requirements:

  1. A system with an index that is able to retrieve all comments on a comment thread (quickly).

  2. Fast access to the list of

The annual Box Diversity Scholarship is back!

We’re excited to announce that we’re now accepting applications for the Box Diversity Scholarship to kick-off the new school year!

At Box, we believe diversity and inclusion are critical to our success and this scholarship is one of the ways …

BoxWorks 2017 Free Expo passes are available now!

BoxWorks 2017 is less than a month away! Even if you can’t attend the full event, why not check out the highlights with our Free Expo Pass?

Join us on October 10-12 at Moscone West in San Francisco to …

How Much Do Developers Earn? Find Out with the Stack Overflow Salary Calculator

According to the National Center for Women & Information Technology, only 26% of professional computing roles in the workforce in the US are held by women. Within prominent companies in the industry, the numbers…
On the data team here at …

GitHub Debug

GitHub is proud to handle thousands of requests per second from our millions of users. The Internet, however, can be a fickle beast of cables and sparks, and sometimes those requests don’t happen very fast (or at all). While we’re …

Scaling Event Sourcing for Netflix Downloads, Episode 2

by Karen Casella, Phillipa Avery, Robert Reta, Joseph Breuer

In the first episode of this series of posts, we introduced the Netflix downloads project and the use cases that led us to consider a solution based on …

Weak cryptographic standards deprecation update

Earlier this year, we announced the deprecation of several weak cryptographic standards. As noted during our initial announcement, the vast majority of HTTPS clients connect to GitHub using TLSv1.2 and won’t be affected by our disabling of TLSv1/…

Parker brings his cheerful self to work

“Bring Your _______ Self to Work” is an important pillar of our Box culture. We’re a pretty mixed bag of different backgrounds and values around here, so the blank is different for each Box employee. In this series, we’ll interview

Query Analyzer: A Tool for Analyzing MySQL Queries Without Overhead

Benchmarking CPU utilization with various tools

 

Metrics Collection

For the initial version of Query Analyzer, we have used MySQL to handle the metrics (basically a time-series data). There are two tables: query_history and query_info. The query_history is where we save …

Getting to Know Shivam Sharma

What are some of the coolest projects that you and your team have been working on?
One of the coolest projects I have had the pleasure of working on is leveraging the Ember Data persistence library and building services on …

Driving the future of work with our Apple iOS Files integration

In June, we announced that Box is integrating with the new Apple Files app to continue driving openness in the enterprise by providing an integrated and consistent experience where best-of-breed apps and services effortlessly work together. The Files app, being …

Scaling Event Sourcing for Netflix Downloads, Episode 1

by Karen Casella, Phillipa Avery, Robert Reta, Joseph Breuer

Early in 2016, several Netflix teams were asked the question: “What would it take to allow members to download and view content offline on their mobile devices?”

For …

Boxer Spotlight: Colleen brings her resilient self to work

“Bring Your _______ Self to Work” is an important pillar of our Box culture. We’re a pretty mixed bag of different backgrounds and values around here, so the blank is different for each Box employee. In this series, we’ll interview

Announcing Yarn 1.0

Today, we are excited to announce the 1.0 release of the Yarn JavaScript package manager, a major step for the project. In the 11 months since its initial release, Yarn has generated a large following. Currently, there are more than …

Finding inter-procedural bugs at scale with Infer static analyzer

The capabilities of static analyzers, which catch bugs before programs are run, are steadily improving. During our work on the Infer static analyzer, we often were asked about the differences between Infer and other open source analysis tools like …

The Incredible Growth of Python

We recently explored how wealthy countries (those defined as high-income by the World Bank) tend to visit a different set of technologies than the rest of the world. Among the largest differences we saw was in the programming language Python. …

Connecting to the Google Vision API via a Proxy

Images are the second most common and fastest growing content type in Box. Last month we introduced image recognition in Box to help unlock the value of these images to your business. We’re applying machine learning to images, making it …

Common Issue Detection for CPU Profiling

The issues encountered are varied, but some common patterns have emerged:

Logging
Logging is very common in services, and is expected to be cheap. However, older logging frameworks, synchronized loggers, short-lived logger objects, and function evaluations during logging can all …

Keeping an eye on our network

Visibility is essential to effectively operating complex systems. As our network has grown, we’ve had to improve the the way we collect data about it to keep up. Key to these improvements has been the ability to tag metrics. Tagging …

Welcoming the Metropolitan Police Service of London to Box

We’re thrilled to announce that the Metropolitan Police Service of London (the Met) is moving to Box. The British police service, covering the Greater London area and its 8.6 million residents, will use up to 50,000 Box seats across the …

New technology partners join us on a cloud content management journey

Every quarter, Box Technology Partners unlock new ways for people to collaborate on, secure, and manage their most important information. We welcomed 27 new partners this quarter who are extending the capabilities of cloud content management into their applications, bringing …

Inside the Developer Experience at BoxWorks ’17

Developers of the world: are you building next level enterprise solutions at your company, or creating versatile, permissioned, file systems in your current workstream? Do you work to keep your identity systems secure, or have to manage private or compliant …

Rapid release at massive scale

Over time, the software industry has come up with several ways to deliver code faster, safer, and with better quality. Many of these efforts center on ideas such as continuous integration, continuous delivery, agile development, DevOps, and test-driven development. All …

LogDevice: a distributed data store for logs

A log is the simplest way to record an ordered sequence of immutable records and store them reliably. Build a data intensive distributed service and chances are you will need a log or two somewhere. At Facebook, we build a …

Optimizing 360 photos at scale

People have uploaded more than 70 million 360 photos to Facebook since we launched the feature last year. Facebook enables multiple methods for capturing 360 photos and videos, which allow people to share immersive experiences with their communities. If you …

A Tale of Two Industries: How Programming Languages Differ Between Wealthy and Developing Countries

Here at Stack Overflow, we’re interested in using our data to share insights about the worldwide software development community. This recent post on the distribution of mobile developers is a good example: it explored traffic to Android questions from around …

Netflix Hack Day — Summer 2017

by Daniel Jacobson, Ruslan Meshenberg, Leslie Posada, and Tom Richards

About a week ago, Netflix hosted another great Hack Day. The event gives Netflix employees a chance to take a break from everyday work, have fun, experiment …

Boxer Spotlight: Phoebe brings her exuberant self to work

“Bring Your _______ Self to Work” is an important pillar of our Box culture. We’re a pretty mixed bag of different backgrounds and values around here, so the blank is different for each Box employee. In this series, we’ll interview

FCR: Open source command runner for network devices

As Facebook continues to grow, we are constantly looking for ways to improve our operations and drive greater efficiency. Operating at a global scale poses unique technical challenges, particularly in the network environment, where large amounts of data are always …

Open Sourcing Kafka Cruise Control

Anomaly detector
The anomaly detector identifies two types of anomalies:

  1. Broker failures: i.e., a non-empty broker leaves a cluster, which results in under-replicated partitions. Since this can happen during normal cluster bounces as well, the anomaly detector provides a configurable

External Library Management

At LinkedIn, when our engineers create software, there is often a need to leverage some of the great work done by the open source community outside of LinkedIn. In our continuous delivery parlance we refer to these assets as External …

Box admins, specialists, and cloud lovers: BoxWorks is around the corner!

OK. You’ve heard it before: “This year’s XXX conference is going to be the best yet!” “Don’t miss XXX conference!” “The top conference of the year!”

I don’t mean to add to the noise, but BoxWorks 2017 will actually be …

An Update on the REACH Program

Co-authors: Shalini Agarwal, Joel Young, Ali Mohamed, and Yi Shen

Earlier this year, we kicked off our inaugural REACH program, which brings in software engineers from non-traditional tech backgrounds to apprentice at LinkedIn for six months. Our …

5 Reasons SMB Professionals Should Attend BoxWorks 2017

In just a couple months, we kick off the 7th annual BoxWorks (October 10-12 at Moscone Center in San Francisco— register now.) Over the course of the conference, you’ll have the opportunity to connect with your peers in similarly-sized …

Creating Video Sharing on LinkedIn

Once the engineering leads came to a shared understanding of how the individual systems would need to interact with one another, the teams developed, prioritized, and scoped their own roadmap for the features and systems for which they were responsible. …

JARVIS: Helping LinkedIn Navigate its Source Code

Relevance

Relevance is a very important piece for any search system, and our codesearch is no exception. It is very important to show files at the top that users are most likely to open. Relevance for us involves assigning a …

Where in the World is Mobile Development?

In a previous post, we used the Stack Overflow Trends tool to look at how technology usage in mobile development has changed over time. But we’ve often found that popular languages, platforms and technologies differ across cities and countries

A Brief History of Open Source from the Netflix Cloud Security Team

by Jason Chan

This summer marks three years of releasing open source software for the Netflix Cloud Security team. It’s been a busy three years — our most recent release marks 15 open source projects — so we figured a

Steering oceans of content to the world

A version of this post was originally published at research.fb.com.

The Facebook network is an integral part of Facebook’s infrastructure. Every day, people and communities rely on Facebook’s global network and infrastructure to share information, ranging from photos and …

Explaining React’s license

A few weeks ago, the Apache Software Foundation (the ASF) made a decision to list the BSD + Patents license as a Category-X license. This move affects users of much of Facebook’s open source software, but especially the popular …

Getting to Know Nikolai Avteniev

What other projects are you involved in outside of video sharing?
Outside of video sharing, I work on projects with the LinkedIn for Good organization. I’m part of a volunteer team of LinkedIn employees who help American veterans get access …

You can see clearly now: intelligent image recognition in Box

Go figure: living in the information age means we’re all dealing with a lot of information. Whether we’re on-boarding new employees, brainstorming with colleagues or engaging with partners, every one of us is interacting with gigabytes of data on a …

Handling missing metrics in Wavefront

At Box, we manage several large scale Kubernetes clusters and heavily rely on real-time metrics to monitor them. In addition to metrics coming from the control plane (for example from kube-state-metrics), all applications running in Kubernetes also emit metrics. …

@Scale 2017 agenda is live!

The 2017 @Scale Conference is coming up August 31 at the San Jose Convention Center. This year’s event will feature tech talks by representatives of leading companies building technology at scale. Adobe, Amazon, Facebook, Google, Microsoft, Netflix, NVIDIA, Okta, Qualcomm,

Kubernetes at GitHub

Over the last year, GitHub has gradually evolved the infrastructure that runs the Ruby on Rails application responsible for github.com and api.github.com. We reached a big milestone recently: all web and API requests are served by containers running in …

Transforming higher education with cloud content management

Over the past few years, Box has been committed to finding ways to bring innovative technology to higher education, and has become the cloud content management solution of choice for hundreds of leading colleges and universities.

After five years leading …

Every document a fortress: Using security classification to protect sensitive information

Part three in a four-post series about information governance.

Security is a major part of good information governance. If the rules you follow to govern your information don’t address security, you could have big problems.

We don’t have to look …

Scaling Contextual Conversation Suggestions Over 500 Million Members

We want to find all the paths of maximum length 3 from a starting node (a viewing member) to a destination node (company), and rank them based on the edges’ weights. Note that we only recommend the first degree connections. …

The TCP Tortoise: Optimizations for Emerging Markets

Serving fast pages is a core aspiration at LinkedIn. As part of this initiative, we continuously experiment and study the various layers of our stack and identify optimizations to ensure that we use the most optimal protocols and configurations …

5 things you may not have known you could do with Box

Do you feel like you’re just scratching the surface of what your Box account can do for you and your team? Over the years, we’ve built lots of simple tools into Box that will make you infinitely more productive — …

InGraphs: Monitoring and Unexpected Artwork

At LinkedIn, we have an internal tool for visualizing operational metrics that we call inGraphs. Since I started working for LinkedIn almost four years ago, I’ve been snapshotting inGraphs that I thought were interesting—the ones that had helped to solve …

Transitioning entirely to neural machine translation

Language translation is one of the ways we can give people the power to build community and bring the world closer together. It can help people connect with family members who live overseas, or better understand the perspective of someone …

Prototyping with React VR

At Airbnb, we’ve been using React to build user interfaces for our website since 2014. React has radically changed our approach to building UI, and we’ve been active contributors to the open source community with projects such as Enzyme,

Migrating to Espresso

Babylonia makes direct writes to Espresso.

 

Ensuring consistency
We’ve had three different processes writing data to our Espresso database: the bulk loader, the Databus listener, and Babylonia itself. One issue we needed to tackle was how we would allow these …

Always wear sunscreen: Using information governance to prepare for defensible discovery

Part two in a four-part series on information governance.

In our first post in this series, we talked about what information governance is and took a look at document retention. Now let’s dive into something new: defensible discovery.

This considers …

Flash is Dead: What Technologies Might Be Next?

Last week, Adobe announced that they would stop supporting Flash by 2020. In some ways this is surprising: I still sometimes run into pages that require Flash, and you can still find a few defenders of the platform in …

Accelerating Services at Airbnb by Building — and Open Sourcing — a Blazing Fast Thrift Binding for…

Achieving Bare-Metal Performance in Ruby

Writing performant code in Ruby can be difficult due to its dynamic nature: unlike lower-level languages where the idiom is zero-cost-abstractions, pretty much everything in a dynamic language is expensive. As such, it was …

Topic Suggestions for Millions of Repositories

We recently launched Topics, a new feature that lets you tag your repositories with descriptive words or phrases, making it easy to discover projects and explore GitHub.com. Topic suggestions on public repositories, provides a quick way to add tags …

Starting the Avalanche

Application DDoS In Microservice Architectures

By Scott Behrens and Bryan Payne

Introduction

We’d like to introduce you to one of the most devastating ways to cause service instability in modern micro-service architectures: application DDoS. A specially crafted application DDoS attack …

Open Sourcing Jaqen, A Tool For Developing DNS Rebinding PoCs

Editor’s note: Members of the information security team at LinkedIn have an opportunity to work on research topics under a well-defined framework that allows them to evaluate new products and technologies, as well as explore the related threat surface. The

Powering Helix’s Auto Rebalancer with Topology-Aware Partition Placement

Partition assignments are critical to a typical distributed data system. A partition’s replicas could be in different states. For example, in the above graph, each partition has three replicas; one of them is the Primary replica, while the other two

Using AI for new visual storytelling techniques in VR

Artificial intelligence is becoming an increasingly important tool within the artistic community to foster visual creativity. Two frequently used techniques are generative adversarial networks (GANs), which can generate visually realistic images, and style transfer, which can turn photos or …