Measure the Internet. Save the data. Make it universally accessible and helpful.https://measurementlab.net/enhttps://measurementlab.net/blog/hermes/https://measurementlab.net/blog/hermes/HERMES turns user-initiated M-Lab speed tests into an open, path-aware view of Internet slowdowns — helping operators, researchers, and policymakers see not only that performance changed, but where along the route the problem may be.Tue, 18 Aug 2026 00:00:00 GMTResearchDataPerformanceLatencyTracerouteObservatoryhttps://measurementlab.net/blog/pulse-fellow-iqb/https://measurementlab.net/blog/pulse-fellow-iqb/Measurement Lab (M-Lab) is excited to announce that Zeynep Arslan (M-Lab Research Fellow, affiliated with the Sorbonne Université) was awarded an Internet Society Pulse fellowship to conduct research exploring the stability and reliability of the Internet Quality Barometer (IQB) framework.Wed, 05 Aug 2026 00:00:00 GMTCommunityResearchAnnouncementhttps://measurementlab.net/blog/cop-july-meeting/https://measurementlab.net/blog/cop-july-meeting/On July 23, 2026, M-Lab and Giga hosted the monthly Connectivity Community of Practice (CoP) call. Hunter Thompson, Director of Telecommunications and Connectivity for the Vermont Department of Public Service, walked the group through Vermont's Mobile Wireless Drive Test Program, and the community shared updates on the IQB-Edu framework, M-Lab's historical stats dataset, a new QoE measurements design document, and UNHCR's cellular data work in displacement contexts.Thu, 30 Jul 2026 00:00:00 GMTEventCommunityResearchEducationhttps://measurementlab.net/blog/cop-qoe-design-document/https://measurementlab.net/blog/cop-qoe-design-document/We are excited to announce the first public draft of a design document describing Quality of Experience (QoE) measurements for schools. This design document has been co-authored by M-Lab and Giga staff members as part of our collaboration to strengthen how connectivity is measured and understood for public facilities, and especially schools. We encourage all members of the Connectivity Community of Practice (CoP) to review, provide feedback, and contribute to our initial design.Thu, 16 Jul 2026 00:00:00 GMTCommunityAnnouncementDesignQoEResearchhttps://measurementlab.net/blog/cop-may-meeting/https://measurementlab.net/blog/cop-may-meeting/Two months after our March launch, the Connectivity Community of Practice (CCoP) gathered again on May 18–19, spanning time zones from Michigan to Uganda, Washington DC to Barcelona. The conversation centered on the Internet Quality Barometer for Education (IQB-Edu) — a new measurement framework designed specifically for school connectivity.Fri, 12 Jun 2026 00:00:00 GMTEventCommunityResearchEducationhttps://measurementlab.net/blog/cop-launch/https://measurementlab.net/blog/cop-launch/On March 11, 2026, M-Lab and Giga formally launched the Connectivity Community of Practice (CCoP) and held the inaugural session with 51 global participants representing backgrounds from academia, industry, civil society and international NGOs. The event introduced the CoP’s initial focus areas and invited participants to help shape its first-year agenda through an interactive Community document.Wed, 18 Mar 2026 00:00:00 GMTEventCommunityAnnouncementPartnershiphttps://measurementlab.net/blog/giga-mlab-cop/https://measurementlab.net/blog/giga-mlab-cop/Measurement Lab (M-Lab) is excited to announce the early launch of a new Connectivity Community of Practice for applied Internet measurement in collaboration with Giga.Thu, 26 Feb 2026 00:00:00 GMTEventCommunityAnnouncementPartnershiphttps://measurementlab.net/blog/omg4/https://measurementlab.net/blog/omg4/From 2024 to 2025, Measurement Lab, Censored Planet, IODA, and OONI organized four convenings called the Open Measurement Gatherings (OMG). The intention of these convenings was to build understanding, trust, and collaboration across open Internet measurement groups and this initiative was made possible with the support of the Open Technology Fund (OTF). From September 8-12, 2025, the Open Measurement Groups groups gathered in Estoril, Portugal for the fourth convening of the two-year program.Mon, 22 Dec 2025 00:00:00 GMTEventCensorship MeasurementCommunityhttps://measurementlab.net/blog/pulse-research-week/https://measurementlab.net/blog/pulse-research-week/From December 8-11, 2025, Measurement Lab (M-Lab) joined the Internet Society Pulse Research Week. On Day 4 Pavlos Sermpezis, M-Lab’s Director, Technical Lead, presented the Internet Quality Barometer prototype at the Giga offices in Barcelona. M-Lab discussed with the audience how IQB could be adapted for education.Thu, 18 Dec 2025 00:00:00 GMTEventCommunityResearchDatahttps://measurementlab.net/blog/revtr_tutorial/https://measurementlab.net/blog/revtr_tutorial/Internet paths are often asymmetric: packets from A to B usually take a different route than packets in the reverse direction from B to A. This post walks through a reproducible case study using Reverse Traceroute (RevTr) to compare forward and reverse paths for NDT speed tests.Thu, 13 Nov 2025 00:00:00 GMTDataCommunityResearchBigqueryTraceroutehttps://measurementlab.net/blog/imc2025-hackathon/https://measurementlab.net/blog/imc2025-hackathon/M-Lab, OONI, IIJ, Dioptra Research Group, Cloudflare Radar, Reverse Traceroute, and IODA hosted the Open Measurement Hackathon, October 31, 2025, following the ACM Internet Measurement Conference (IMC) 2025 in Madison, Wisconsin, USA.Wed, 12 Nov 2025 00:00:00 GMTEventCommunityResearchDatahttps://measurementlab.net/blog/dynamic-data-bq/https://measurementlab.net/blog/dynamic-data-bq/A new dataset of ndt7 measurements is now available in BigQuery, offering access to measurements from a set of servers whose data had not been previously published.Tue, 15 Jul 2025 00:00:00 GMTDataBigqueryNDT7Announcementhttps://measurementlab.net/blog/omg3/https://measurementlab.net/blog/omg3/On June 25, 2025, the Open Measurement Gathering (OMG) held a public event, “Open Measurement Gathering AMA”, featuring Censored Planet, IODA, OONI, and Measurement Lab.Tue, 15 Jul 2025 00:00:00 GMTEventCensorship MeasurementCommunityhttps://measurementlab.net/blog/iqb/https://measurementlab.net/blog/iqb/Measurement Lab is happy to announce the publication of the Internet Quality Barometer Framework!Mon, 30 Jun 2025 00:00:00 GMTPublicationAnnouncementhttps://measurementlab.net/blog/iprs-data-on-mlab/https://measurementlab.net/blog/iprs-data-on-mlab/We are excited to announce that the Dioptra research group at Sorbonne University is making its IP Route Survey (IPRS) available on M-Lab.Mon, 16 Jun 2025 00:00:00 GMTDataPartnershipBigqueryTracerouteAnnouncementhttps://measurementlab.net/blog/improving-m-lab-geolocation/https://measurementlab.net/blog/improving-m-lab-geolocation/This blog post describes the two geolocation systems M-Lab uses for server selection and data annotation and how researchers can leverage metadata about the server selection to identify potentially erroneous client geolocation results in the annotated data.Tue, 27 May 2025 00:00:00 GMTDataAccuracyResearchCommunityhttps://measurementlab.net/blog/pavlos-joins-mlab/https://measurementlab.net/blog/pavlos-joins-mlab/Measurement Lab is pleased to announce the addition of Pavlos Sermpezis to our team as our new Director, Tech Lead. Many highly qualified and inspiring candidates applied for this position, and after extensive review we are pleased to announce Pavlos Sermpezis as Director, Tech Lead at Measuremen...Mon, 21 Apr 2025 00:00:00 GMTLeadershipAnnouncementhttps://measurementlab.net/blog/open-measurement-gathering-2/https://measurementlab.net/blog/open-measurement-gathering-2/The second Open Measurement Gathering took place in December 2024, organized by Measurement Lab (M-Lab) in collaboration with and hosted by the Internet Outage Detection and Analysis (IODA) project at Georgia Tech’s Internet Intelligence Lab. For the second convening, the OMG groups focused on de...Wed, 16 Apr 2025 00:00:00 GMTEventCensorship MeasurementCommunityhttps://measurementlab.net/blog/open-measurement-gathering-1-public-report/https://measurementlab.net/blog/open-measurement-gathering-1-public-report/Fri, 11 Oct 2024 00:00:00 GMTEventCensorship MeasurementCommunityhttps://measurementlab.net/blog/open-measurement-gathering-1/https://measurementlab.net/blog/open-measurement-gathering-1/From June 11th-13th, 2024, Measurement Lab (M-Lab) organized and participated in the first of four convenings that will take place over the course of the Open Measurement Gatherings (OMG) project. The inaugural event was planned in collaboration with the Internet Outage Detection and Analysis (IO...Wed, 14 Aug 2024 00:00:00 GMTEventCensorship MeasurementCommunityhttps://measurementlab.net/blog/melissa-newcomb-announcement/https://measurementlab.net/blog/melissa-newcomb-announcement/Measurement Lab is pleased to announce the addition of Melissa Newcomb to our team as our new Senior Program Manager.Thu, 20 Jun 2024 00:00:00 GMTLeadershipAnnouncementhttps://measurementlab.net/blog/jun24-community-call/https://measurementlab.net/blog/jun24-community-call/Join our monthly community call on June 6, 2024 at 11am ET to discuss Dioptra’s recent work on fast-mda-traceroute and considerations that have gone into its design and testing.Wed, 05 Jun 2024 00:00:00 GMTCommunityTracerouteResearchhttps://measurementlab.net/blog/apr24-community-call/https://measurementlab.net/blog/apr24-community-call/Interested in metrics that measure an Internet connection's quality from the end user perspective? Join us at our April M-Lab Community Call on April 4, 2042 at 11am EDT.Tue, 26 Mar 2024 00:00:00 GMTCommunityInternet QualityResearchhttps://measurementlab.net/blog/contributing-mlab-infrastructure/https://measurementlab.net/blog/contributing-mlab-infrastructure/We've added a new, flexible set of options to expand and diversify our global fleet of measurement vantage points.Mon, 18 Mar 2024 00:00:00 GMTPlatformInfrastructureContributionhttps://measurementlab.net/blog/feb24-community-call/https://measurementlab.net/blog/feb24-community-call/Access to high speed Internet does not necessarily mean access to high quality Internet. But if not speed then what? How should we measure Internet quality? Join our monthly community call on February 1, 2024 at 11am ET to discuss and contribute to our latest research initiative, sponsored by I...Tue, 23 Jan 2024 00:00:00 GMTCommunityInternet QualityResearchhttps://measurementlab.net/blog/end-of-year-letter-2023/https://measurementlab.net/blog/end-of-year-letter-2023/2023 was a big year! Here’s a summary of what we were up to and what's coming up next.Thu, 21 Dec 2023 00:00:00 GMTAnnual Reviewhttps://measurementlab.net/blog/wehe-bigquery-announcement/https://measurementlab.net/blog/wehe-bigquery-announcement/M-Lab and the Wehe team are pleased to announce that Wehe data is available for open access in BigQuery.Thu, 28 Sep 2023 00:00:00 GMTWeheDataBigqueryhttps://measurementlab.net/blog/imc-hackathon-2023/https://measurementlab.net/blog/imc-hackathon-2023/Are you attending the Internet Measurement Conference (IMC) 2023?Mon, 28 Aug 2023 00:00:00 GMTDataEventResearchhttps://measurementlab.net/blog/introducing-msak/https://measurementlab.net/blog/introducing-msak/Since its inception, M-Lab's flagship bulk transport capacity (BTC) measurement protocol, NDT, has always been using a single TCP stream. While this allowed us to get detailed diagnostic data about the user's connection, over time many have expressed concerns about the ability of the single-s...Wed, 26 Jul 2023 00:00:00 GMTPlatformAnnouncementhttps://measurementlab.net/blog/july2023-officehours/https://measurementlab.net/blog/july2023-officehours/Join us for M-Lab's next Community Office Hours on July 20, 2023 at 11:00am EDT!Thu, 20 Jul 2023 00:00:00 GMTCommunityDataLearningAnalysishttps://measurementlab.net/blog/short-ndt/https://measurementlab.net/blog/short-ndt/Consumer Internet speeds increasing to 1Gbps and beyond pose a scaling challenge to servers engaged in measuring global Internet quality, as every bit represents physical infrastructure and energy costs to measure that information. Maintainers of Measurement Lab are investigating options to limit...Mon, 26 Jun 2023 00:00:00 GMTNDTDatahttps://measurementlab.net/blog/introducing-office-hours/https://measurementlab.net/blog/introducing-office-hours/Are you new to M-Lab data? Do you have questions about how to use it or how it can fit into your research?Fri, 16 Jun 2023 00:00:00 GMTCommunityDataLearningAnalysishttps://measurementlab.net/blog/retiring-ndt5-raw/https://measurementlab.net/blog/retiring-ndt5-raw/After January 2024, M-Lab will no longer support the legacy ndt5+raw protocol or mlab-ns.appspot.com service. There are alternatives available for migration now.Mon, 08 May 2023 00:00:00 GMTPlatformNDTNdt5Announcementhttps://measurementlab.net/blog/virtual-sites-gcp/https://measurementlab.net/blog/virtual-sites-gcp/As of April 2023, we are excited to announce that M-Lab has a virtual site running ndt-server in all 35 GCP regions.Mon, 24 Apr 2023 00:00:00 GMTPlatformCloudAnnouncementhttps://measurementlab.net/blog/cloudflare-aimscoredata-announcement/https://measurementlab.net/blog/cloudflare-aimscoredata-announcement/Want to know more about your Internet connection? M-Lab is proud to announce that we are now publishing Cloudflare’s Aggregated Internet Measurement (AIM) dataset, which puts network quality in an end-user context.Tue, 18 Apr 2023 00:00:00 GMTPartnershipDataBigqueryAimCloudflareAnnouncementhttps://measurementlab.net/blog/katherine-townsend-announcement/https://measurementlab.net/blog/katherine-townsend-announcement/Measurement Lab is pleased to announce the addition of Katherine Townsend to our team as our new Director.Tue, 17 Jan 2023 00:00:00 GMTLeadershipAnnouncementhttps://measurementlab.net/blog/imc22-hackathon/https://measurementlab.net/blog/imc22-hackathon/Summary of M-Lab's hackathon at IMC 2022!Wed, 02 Nov 2022 00:00:00 GMTEventDataHackathonhttps://measurementlab.net/blog/underload/https://measurementlab.net/blog/underload/Guest blog post by Michael Wezl (Full Professor at University of Oslo, Norway) discussing the use of Measurement Lab’s Neubot data to research Internet congestion control.Tue, 20 Sep 2022 00:00:00 GMTGuestResearchNeubothttps://measurementlab.net/blog/sigcomm2022/https://measurementlab.net/blog/sigcomm2022/Measurement-Lab was excited to be represented at this year’s SIGCOMM conference with a tutorial and conference talk in the Best of CCR session. This post overviews M-Lab’s activities at SIGCOMM and includes references for the tutorial materials.Wed, 14 Sep 2022 00:00:00 GMTNDTBigqueryDataEventResearchhttps://measurementlab.net/blog/mlab_hackathon_at_imc/https://measurementlab.net/blog/mlab_hackathon_at_imc/Come analyze Internet performance data with M-Lab at ACM Internet Measurement Conference 2022!Wed, 31 Aug 2022 00:00:00 GMTNDTBigqueryDataEventResearchhttps://measurementlab.net/blog/update-unified-views/https://measurementlab.net/blog/update-unified-views/Monday August 15th we will be updating the NDT unified views to provide researchers with access to the row filter logic used to exclude rows that are not believed to be representative measurements of network performance. This change enables interested researchers to better understand MLab’s data ...Fri, 05 Aug 2022 00:00:00 GMTBigqueryResearchDatahttps://measurementlab.net/blog/2022-mlab-to-the-cloud/https://measurementlab.net/blog/2022-mlab-to-the-cloud/M-Lab is excited to announce “M-Lab to the Cloud”, beginning with our pilot deployment of NDT servers on cloud infrastructure.Wed, 27 Jul 2022 00:00:00 GMTCloudPlatformAnnouncementhttps://measurementlab.net/blog/2022-extracting-single-traceroute/https://measurementlab.net/blog/2022-extracting-single-traceroute/In response to community feedback, we've developed a proof of concept tool that examines and extracts single-paths scamper ‘s MDA traceroutes.Fri, 22 Jul 2022 00:00:00 GMTTracerouteResearchDatahttps://measurementlab.net/blog/2022-fellowship-videos/https://measurementlab.net/blog/2022-fellowship-videos/Recordings of the 2022 M-Lab Fellowship Presentations and Reports.Thu, 14 Jul 2022 00:00:00 GMTFellowshipResearchCommunityhttps://measurementlab.net/blog/2022-fellowship-presentations/https://measurementlab.net/blog/2022-fellowship-presentations/Come learn about the exciting research that the M-Lab Fellows completed during their fellowship!Tue, 28 Jun 2022 00:00:00 GMTFellowshipResearchCommunityhttps://measurementlab.net/blog/overview-of-mlab-traceroute/https://measurementlab.net/blog/overview-of-mlab-traceroute/This blog post is a report on M-Lab's traceroute data so the community can have a better understanding of what the data we make available includes.Wed, 08 Jun 2022 00:00:00 GMTTracerouteResearchDatahttps://measurementlab.net/blog/laiyi-role-change-update/https://measurementlab.net/blog/laiyi-role-change-update/A note from Lai Yi Ohlsen to the Measurement Lab community.Tue, 31 May 2022 00:00:00 GMTAnnouncementhttps://measurementlab.net/blog/updates-to-geo-filters/https://measurementlab.net/blog/updates-to-geo-filters/Changes to our geographic annotations have resulted in changes to geographic filters.Thu, 24 Mar 2022 00:00:00 GMTResearchDataPipelineAnnotationshttps://measurementlab.net/blog/user-privacy-research-usability-townhall-summary/https://measurementlab.net/blog/user-privacy-research-usability-townhall-summary/On March 16 we hosted a town hall discussion regarding M-Lab’s collection of IP addresses and asked for feedback on potential alternatives. We are accepting comments on the techniques we proposed until April 1.Fri, 18 Mar 2022 00:00:00 GMTCommunityPrivacyResearchhttps://measurementlab.net/blog/user-privacy-research-usability-townhall/https://measurementlab.net/blog/user-privacy-research-usability-townhall/Presentation on the benefits and challenges of M-Lab’s collection of IP addresses and feedback solicitation for potential alternativesMon, 28 Feb 2022 00:00:00 GMTCommunityPrivacyResearchhttps://measurementlab.net/blog/run-a-private-ndt-server/https://measurementlab.net/blog/run-a-private-ndt-server/Back in 2019, I wrote about how to install the open source ndt-server that M-Lab uses, on a server of your own. Our goal is that others can use M-Lab's tools to measure their own networks. This post is an update, with a couple more features.Wed, 16 Feb 2022 00:00:00 GMTNDT ServerTutorialhttps://measurementlab.net/blog/arc-research-pt2/https://measurementlab.net/blog/arc-research-pt2/In this second “analysis recommendations in context” post, we will explore the refined research questions from the first post, resulting from our discussion of how to design specific questions with understanding of available data source(s) and the context of what each contains. We emphasized the ...Mon, 14 Feb 2022 00:00:00 GMTNDTResearchBigqueryDataTutorialhttps://measurementlab.net/blog/v2-data-pipeline-migration/https://measurementlab.net/blog/v2-data-pipeline-migration/If you typically use the measurement-lab.ndt.unifieduploads or measurement-lab.ndt.unifieddownloads views, then nothing will change. We are updating the ndt5, switch, and tcpinfo schemas, removing obsolete views, and renaming some views in preparation for improving ease of use and documenta...Thu, 10 Feb 2022 00:00:00 GMTPipelineNDTTracerouteDatahttps://measurementlab.net/blog/arc-of-research-pt1/https://measurementlab.net/blog/arc-of-research-pt1/A while back, our team published some analysis recommendations for anyone working with our data from the Network Diagnostic Tool (NDT), comparing it to other Internet measurement data sets, and drawing conclusions or inferences about the data. These recommendations are intended to provide guidanc...Wed, 09 Feb 2022 00:00:00 GMTNDTResearchBigqueryDatahttps://measurementlab.net/blog/traceroute-access-and-rfc-results/https://measurementlab.net/blog/traceroute-access-and-rfc-results/Two recent disucssions on Traceroute on our M-Lab Discuss group provided clarity on how to access Traceroute data in BigQuery, as well as solicited feedback from the community on proposed changes to the traceroute output format.Wed, 02 Feb 2022 00:00:00 GMTTraceroutehttps://measurementlab.net/blog/revisiting-national-broadband-datasets-and-maps/https://measurementlab.net/blog/revisiting-national-broadband-datasets-and-maps/When thinking about broadband in the United States, the first thing people likely think about is whether their connection is fast enough-- are they getting the speeds they need to do business, go to school, etc. The dominance of “speed” in assessing broadband service goes all the way to the top- ...Mon, 24 Jan 2022 00:00:00 GMTNDTOoklaDataStatisticshttps://measurementlab.net/blog/research-fellow-announcement/https://measurementlab.net/blog/research-fellow-announcement/M-Lab is pleased to share our selection of Research Fellows for Spring 2022, generously supported by Internet Society. The fellows were selected for the merit, rigor, and feasibility of their proposed project as well as their research's relevance to improvement for end-user Internet performance. ...Thu, 13 Jan 2022 00:00:00 GMTFellowshipResearchAnnouncementhttps://measurementlab.net/blog/rfc-traceroute-format-change/https://measurementlab.net/blog/rfc-traceroute-format-change/M-Lab’s traceroute-caller (TRC) tool was designed and developed in early 2019 as a sidecar service running on M-Lab servers. Its purpose is to collect traceroute data to any remote IP address after it closes its TCP connection to an M-Lab server. TRC uses the scamper tool for running traceroutes.Mon, 10 Jan 2022 00:00:00 GMTTraceroutehttps://measurementlab.net/blog/community-call-agenda-20211215/https://measurementlab.net/blog/community-call-agenda-20211215/At TPRC 2021, Dave Clark and Sare Wedeman presented “Measurement, Meaning and Purpose: Exploring the NDT Dataset” which raises relevant and timely questions about M-Lab’s NDT dataset and its potential applications. Please join us Wednesday, December 15, 2021 from 11am-12:00 pm Eastern for a prese...Mon, 06 Dec 2021 00:00:00 GMTCommunityNDThttps://measurementlab.net/blog/research-fellowship-call/https://measurementlab.net/blog/research-fellowship-call/How can M-Lab’s data and platform be used to improve the experience of the Internet for the end user? Measurement Lab is seeking three Research Fellows to expand Internet performance research beyond the measurement and optimization for bandwidth. Fellows will utilize M-Lab’s longitudinal, open da...Thu, 04 Nov 2021 00:00:00 GMTResearchFellowshiphttps://measurementlab.net/blog/experiment-review-committee/https://measurementlab.net/blog/experiment-review-committee/The M-Lab Experiment Review Committee met on October 21, 2021. The following is a summary of our discussion.Fri, 29 Oct 2021 00:00:00 GMTGovernanceExperiment Review Committeehttps://measurementlab.net/blog/community-call-announcement/https://measurementlab.net/blog/community-call-announcement/Internet performance is often measured by download and upload “speed” but there are other metrics that can help measure connectivity, such as latency, bufferbloat and a more recently discussed metric: responsiveness. Join us next Wednesday, August 25, 2021 from 11am-12:30pm Eastern for a conv...Wed, 18 Aug 2021 00:00:00 GMTCommunityLatencyBufferbloatResponsivenesshttps://measurementlab.net/blog/ntia/https://measurementlab.net/blog/ntia/The National Telecommunications and Information Administration’s (NTIA) recently released a new public map, the [Indicators of Broadband Need][ntia]. Pulling together different sources of data in this excellent, publicly available resource is helpful to communities as they plan how and where to i...Thu, 15 Jul 2021 00:00:00 GMTNDTDigital Inclusionhttps://measurementlab.net/blog/ndt7-updates/https://measurementlab.net/blog/ndt7-updates/In the past month we’ve made several improvements to ndt-server, ndt7-client-js, and ndt7-client-go. If you have any questions about the following, please comment on the relevant Github issues.Tue, 29 Jun 2021 00:00:00 GMTNDT7NDT Serverhttps://measurementlab.net/blog/evolution-of-annotations/https://measurementlab.net/blog/evolution-of-annotations/In our recent [roadmap post][roadmap], we shared a list of milestones that the team is working on this and last quarter. Our Datatype migration and Standardized Columns milestone references the [gardener service][gardener], which maintains and reprocesses M-Lab data, as well as the [UUID annotato...Tue, 09 Mar 2021 00:00:00 GMTResearchDataPipelinehttps://measurementlab.net/blog/monthly-newsletter/https://measurementlab.net/blog/monthly-newsletter/Hello! I hope this finds you well. Today I’m writing with the first of many newsletters that you’ll receive on this mailing list. In each monthly edition, we’ll provide updates about M-Lab such as changes to our platform and pipeline, data schemas, community tools, best practice analyses, communi...Fri, 05 Mar 2021 00:00:00 GMTCommunityhttps://measurementlab.net/blog/community-call-schedule/https://measurementlab.net/blog/community-call-schedule/In 2021, Measurement Lab will facilitate a series of community calls focusing on 3 core topics: General M-Lab updates, Internet Measurement Research and Broadband Advocacy/Policy. We will rotate through these topics on the fourth Wednesday of every month and every meeting will take place at 11am ...Wed, 03 Mar 2021 00:00:00 GMTCommunityhttps://measurementlab.net/blog/mlab-data-policy-advocacy/https://measurementlab.net/blog/mlab-data-policy-advocacy/For researchers, policy makers, governing bodies, advocacy groups, or anyone who wants to understand M-Lab data and how it compares to other internet measurement data sets, M-Lab has begun to develop recommendations for appropriate use of our data in their analyses and reports.Wed, 17 Feb 2021 00:00:00 GMTResearchPolicyAdvocacyhttps://measurementlab.net/blog/why-access-tokens/https://measurementlab.net/blog/why-access-tokens/Performing a measurement with ndt7 on the M-Lab platform now requires an access token issued by the Locate API v2.Fri, 12 Feb 2021 00:00:00 GMTNDTNDT7https://measurementlab.net/blog/wehe-launch/https://measurementlab.net/blog/wehe-launch/The M-Lab team is excited to officially announce the launch of the [Wehe][wehe-test] measurement service on the platform. Working closely with the Wehe research team headed by [David Choffnes][david-choffnes], Associate Professor at Northeastern University, M-Lab launched the new measurement serv...Mon, 25 Jan 2021 00:00:00 GMTWehePlatformhttps://measurementlab.net/blog/roadmap-update/https://measurementlab.net/blog/roadmap-update/In an effort to communicate more about the status and trajectory of the M-Lab platform with our community, we’re pleased to provide this first roadmap update which will cover Q4 2020- Q1 2021. Our team currently plans our milestones and tasks every 6 months, with regular internal meetings and up...Mon, 02 Nov 2020 00:00:00 GMTRoadmaphttps://measurementlab.net/blog/exploring-geographic-limits-of-ip-geolocation/https://measurementlab.net/blog/exploring-geographic-limits-of-ip-geolocation/Baltimore Data Day is an annual conference bringing together “community leaders, nonprofit organizations, government and civic-minded technologists to explore trends in community-based data and learn how other groups are using data to support and advance constructive change.” Th...Fri, 18 Sep 2020 00:00:00 GMTNDTBigqueryDataGIShttps://measurementlab.net/blog/ndt7-access-tokens/https://measurementlab.net/blog/ndt7-access-tokens/Starting October 7th, 2020, the ndt7 server on the M-Lab platform will require access tokens issued by the Locate API v2 to run a measurement.Thu, 10 Sep 2020 00:00:00 GMTNDTNDT7https://measurementlab.net/blog/most-ndt-clients-migrated-to-ndt7/https://measurementlab.net/blog/most-ndt-clients-migrated-to-ndt7/Over the past month, M-Lab has published a series of blog posts about ndt7. As of Thursday, August 13th, 2020 roughly 90% of NDT clients using secure websockets have completed the migration from ndt5 to ndt7.Thu, 27 Aug 2020 00:00:00 GMTNDTNDT7https://measurementlab.net/blog/evolution-of-ndt/https://measurementlab.net/blog/evolution-of-ndt/NDT measures "bulk transport capacity": the maximum date rate that TCP can reliably deliver data using the unreliable IP protocol over an end-to-end Internet path. TCP's goal is to send data at exactly the optimal rate for the network, containing just the right mix of new data and retransmissions...Wed, 05 Aug 2020 00:00:00 GMTNDTNDT7ResearchBBRTCP_INFOWeb100https://measurementlab.net/blog/migrating-ndt-clients-to-ndt7/https://measurementlab.net/blog/migrating-ndt-clients-to-ndt7/Following the [general availability of the ndt7 protocol][ndt7intro], we will be working with NDT client integrators to support their migration to ndt7. As they do, the NDT dataset will shift from predominantly ndt5 to predominantly ndt7. As part of assessing our readiness for this larger effort,...Fri, 24 Jul 2020 00:00:00 GMTNDTNDT7ResearchBBRTCP_INFOhttps://measurementlab.net/blog/ndt7-introduction/https://measurementlab.net/blog/ndt7-introduction/The new ndt7 protocol for the [Network Diagnostic Tool (NDT)][ndt] is now generally available on the M-Lab platform. Since 2009, NDT has been the premier TCP performance measurement service test hosted by M-Lab. During its history on the platform, NDT has produced the largest te...Wed, 22 Jul 2020 00:00:00 GMTNDTNDT7ResearchBBRTCP_INFOPlatformKernelhttps://measurementlab.net/blog/measurement-observations-on-network-performance-during-the-covid-19-pandemic-in-northern-italy/https://measurementlab.net/blog/measurement-observations-on-network-performance-during-the-covid-19-pandemic-in-northern-italy/OONI was recently invited to participate in a NetGain Partnership webinar (titled “Surging Demand and The Global Internet Infrastructure”) to discuss the changing landscape for internet infrastructure and technology in the wake of the COVID-19 pandemic. As part...Fri, 17 Jul 2020 00:00:00 GMTDataBigqueryResearchCovid19https://measurementlab.net/blog/long-term-schema-support-standard-columns/https://measurementlab.net/blog/long-term-schema-support-standard-columns/Following the M-Lab platform upgrade in Nov. 2019, the development team began a series of follow up projects to enable access to NDT data for various audiences with differing needs. The first step in that process was the publication of "unified views", which present the most commonly used fields ...Wed, 15 Jul 2020 00:00:00 GMTDataBigquerySchemahttps://measurementlab.net/blog/covid-19-response-dashboards/https://measurementlab.net/blog/covid-19-response-dashboards/In response to increased reliance on the Internet during the COVID-19 pandemic Measurement Lab, with the support of Internet Society, is dedicated to making our NDT data more accessible so everyone with an interest in Internet Performance can use our data in their research. We s...Wed, 20 May 2020 00:00:00 GMTCovid19CommunityDatahttps://measurementlab.net/blog/vis-site-upgrade/https://measurementlab.net/blog/vis-site-upgrade/The M-Lab team completed a major platform upgrade in November 2019, which required publication of NDT data to new BigQuery tables and views. Consequently, the aggregate NDT data presented on our visualization website has not been updated. We're pleased to report that the M-Lab data visualization ...Wed, 20 May 2020 00:00:00 GMTDataVisualizationhttps://measurementlab.net/blog/new-fqdns-experiments/https://measurementlab.net/blog/new-fqdns-experiments/If you have integrated NDT into a client that does not use our Locate Service, please be aware of the following change. If your NDT client uses our Locate Service, you should not notice a change. Fully Qualified Domain Names for M-Lab experiments will be changing soon.Thu, 07 May 2020 00:00:00 GMTPlatformhttps://measurementlab.net/blog/new-ndt-unified-views/https://measurementlab.net/blog/new-ndt-unified-views/In November 2019, M-Lab reached a milestone after upgrading the operating system, virtualization, and TCP measurement instrumentation running on our servers worldwide. The upgrade also included a completely re-written ndt-server, providing backward compatibility to old clients, as well as the new...Thu, 07 May 2020 00:00:00 GMTNDTBigqueryDatahttps://measurementlab.net/blog/ndt-server-bug-fix-js-clients-update/https://measurementlab.net/blog/ndt-server-bug-fix-js-clients-update/A bug fix was recently deployed to M-Lab's NDT JavaScript client code resolving user support reports of consistently higher than expected upload measurements reported in the browser for tests run via speed.measurementlab.net. M-Lab recommends that any third parties who integrate the NDT test in J...Wed, 22 Apr 2020 00:00:00 GMTBugUpgradesDeveloperhttps://measurementlab.net/blog/mlab-public-statement-samknows-experiment/https://measurementlab.net/blog/mlab-public-statement-samknows-experiment/Measurement Lab (M-Lab) has been a supportive partner of the FCC’s Measuring Broadband America program since its beginning due to the program’s commitment to openness, open data and transparency which aligns closely with M-Lab’s mission around open data and open source internet measurement. Measu...Wed, 08 Apr 2020 00:00:00 GMTPlatformOpen SourceCommunityhttps://measurementlab.net/blog/datastudio-covid19-test-rates-increase/https://measurementlab.net/blog/datastudio-covid19-test-rates-increase/Measurement Lab’s dataset is free, open, and full of data for Internet researchers to study how the Internet is performing under the increased COVID-19 related Internet usage. The DataStudio dashboards below correspond to the internal monitoring metrics we posted last week. They show data about t...Fri, 03 Apr 2020 00:00:00 GMTCovid19Communityhttps://measurementlab.net/blog/covid19-test-rates-increase/https://measurementlab.net/blog/covid19-test-rates-increase/As COVID-19's impact increases globally, more people are working, learning and living online. Internet infrastructure is critical in these moments. The user-initiated measurements collected by M-Lab provide an opportunity to understand whether our shared infrastructure can handle the unprecedente...Wed, 01 Apr 2020 00:00:00 GMTCovid19Communityhttps://measurementlab.net/blog/digital-inclusion-at-home/https://measurementlab.net/blog/digital-inclusion-at-home/As COVID-19’s impact increases globally, more people are working, learning and living online. In partnership with NDIA, X-Lab, ILSR and Marconi Society, Measurement Lab has set up a speed test portal to collect geolocated data with an accompanying survey focused on Digital Inclusion @ Home.Fri, 20 Mar 2020 00:00:00 GMTDigital InclusionSurveySpeedCommunityCovid19https://measurementlab.net/blog/scamper-data/https://measurementlab.net/blog/scamper-data/M-Lab has always committed to provide traceroute data for the tests running on M-Lab platform. Since we launched new platform in 2019 Q4, the new traceroute binary, Scamper, replaced Paris Traceroute on all our servers. Our BigQuery table for traceroute now has...Fri, 31 Jan 2020 00:00:00 GMTDataParis TracerouteTracerouteCommunityhttps://measurementlab.net/blog/the-platform-has-landed/https://measurementlab.net/blog/the-platform-has-landed/After years of planning and steady development, the new M-Lab 2.0 platform has landed. We want to express special thanks to those who have supported the project and helped us get here.Mon, 27 Jan 2020 00:00:00 GMTPlatformCommunityhttps://measurementlab.net/blog/platform-transition-ndt-dataset-tables-views/https://measurementlab.net/blog/platform-transition-ndt-dataset-tables-views/If you've been following our blog over the last few months, you know M-Lab has been working toward a complete server platform upgrade. As of November 20, 2019, all M-Lab servers are now managed by Kubernetes, running Docker container services for all experiments. This transition has greatly impro...Fri, 13 Dec 2019 00:00:00 GMTDataNDTSchemahttps://measurementlab.net/blog/run-your-own-ndt-server/https://measurementlab.net/blog/run-your-own-ndt-server/If you've followed the M-Lab blog over the past year and a half, you'll know that we've been engineering and testing a massive upgrade to our server software and how it's managed and deployed \[1\] \[2\] \[3\] \[4\]. That's been a ton of work, and our team is excited to now complete the migration...Tue, 26 Nov 2019 00:00:00 GMTDataOpen SourcePerformanceTCP_INFONDT Serverhttps://measurementlab.net/blog/supporting-internet-self-determination-at-the-2019-indigenous-connectivity-summit/https://measurementlab.net/blog/supporting-internet-self-determination-at-the-2019-indigenous-connectivity-summit/Last week M-Lab was honored to attend and contribute at the 2019 Indigenous Connectivity Summit (ICS), presented by Internet Society, in Hilo, Hawai'i; and a community network training and building event in the soverign lands of indigenous Hawaiian people, Pu'u...Fri, 25 Oct 2019 00:00:00 GMTCommunityhttps://measurementlab.net/blog/global-pilot-success/https://measurementlab.net/blog/global-pilot-success/We deployed the new M-Lab platform to 1/3rd of the M-Lab fleet, and now we need to assess whether or not it is a performance regression, relative to the old platform. As long as we can be sure the performance of the new platform does not constitute a regression, then we can roll out the new platf...Mon, 14 Oct 2019 00:00:00 GMTPlatformResearchDataKernelOpen SourcePerformanceTCP_INFOhttps://measurementlab.net/blog/inspiring-michigan-broadband-summit/https://measurementlab.net/blog/inspiring-michigan-broadband-summit/The first annual Michigan Broadband Summit was held on Sept. 24, 2019, sponsored by the MERIT research and education network, and it was my pleasure to attend on behalf of M-Lab. The gathering was an opportunity to learn more about the amazing work that MERIT, ind...Fri, 04 Oct 2019 00:00:00 GMTDataCommunityhttps://measurementlab.net/blog/celebrating-2billion-ndt-tests/https://measurementlab.net/blog/celebrating-2billion-ndt-tests/While we've been hard at work this year on the M-Lab 2.0 Platform Upgrade and Global Pilot, the number of people all over the world runing NDT tests has continued to grow. We collected 2 billion total NDT results between 2009-01-01 and the beginning of the second quarter of 2019, and we are on tr...Wed, 18 Sep 2019 00:00:00 GMTDatahttps://measurementlab.net/blog/traceroute-bq-newdata-available/https://measurementlab.net/blog/traceroute-bq-newdata-available/To make our traceroute data in BigQuery more useful, researchers have sought an easy [way to reconstruct the path of hops][1] for the same test. This task was particularly hard because the schema, which was designed many years ago, put the hops of the same test in different rows...Thu, 01 Aug 2019 00:00:00 GMTDataParis TracerouteCommunityhttps://measurementlab.net/blog/global-pilot-entry/https://measurementlab.net/blog/global-pilot-entry/For a while, we’ve been developing M-Lab 2.0 [[1][1], [2][2]]. This month, we are launching a global pilot for the new software stack. The changes include: Stock Linux 4.19 LTS kernels with modern TCP and Cubic congestion control Standard instrumentation fo...Tue, 30 Jul 2019 00:00:00 GMTPlatformResearchDataKernelOpen SourcePerformanceTCP_INFOhttps://measurementlab.net/blog/update_to_mlab_policies/https://measurementlab.net/blog/update_to_mlab_policies/Earlier this month, M-Lab published updates to our policies after completing a comprehensive review to ensure our compliance with the EU General Data Protection Regulation (GDPR) and in preparation for the M-Lab 2.0 platform modernization update that will be rolled out this fall. This post outlin...Fri, 19 Jul 2019 00:00:00 GMTPoliciesGDPRPrivacyhttps://measurementlab.net/blog/ais-workshop/https://measurementlab.net/blog/ais-workshop/M-Lab was pleased to be invited to contribute to the Internet Measurements workshop at the [2019 African Internet Summit][ais2019], June 15-16, 2019 in Kampala, Uganda. M-Lab tech lead, Peter Boothe, and advisor, Georgia Bullen, presented a hands-on tutorial on querying and visualizing performanc...Mon, 01 Jul 2019 00:00:00 GMTDataData AnalysisCommunityhttps://measurementlab.net/blog/traceroute-bq-newdata-temporary-stop/https://measurementlab.net/blog/traceroute-bq-newdata-temporary-stop/Wed, 26 Jun 2019 00:00:00 GMTDataData AnalysisCommunityhttps://measurementlab.net/blog/bq-datasets/https://measurementlab.net/blog/bq-datasets/Earlier this year, M-Lab published blog post outlining our new ETL pipeline and transition to new BigQuery tables. That post also outlined where we’ve saved our datasets, tables, and views in BigQuery historically, and recommended tables and views for most researchers to use. At that time we also...Thu, 02 May 2019 00:00:00 GMTDataBigquerySchemahttps://measurementlab.net/blog/michigan-moonshot/https://measurementlab.net/blog/michigan-moonshot/M-Lab is excited to highlight the launch of "Michigan Moonshot", a pilot data collection project developed through a partnership with the MERIT Network, Michigan State University’s Quello Center, and M-Lab. We worked with MERIT developers who adapted the Piecew...Fri, 26 Apr 2019 00:00:00 GMTDataData AnalysisVisualizationCommunityhttps://measurementlab.net/blog/visualization-site-update/https://measurementlab.net/blog/visualization-site-update/If you’ve clicked on the Visualizations page on our website in the last year or so, and tried to find recent data for any location, you’ve likely been disappointed. TLDR; - Our visualization site is BACK! Continue reading to learn more..Mon, 01 Apr 2019 00:00:00 GMTDataData AnalysisVisualizationhttps://measurementlab.net/blog/communities-driving-broadband-mapping/https://measurementlab.net/blog/communities-driving-broadband-mapping/Over the past few years, M-Lab has supported an increasing number of local communities, municipalities, regional coalitions, and others who are interested in understanding the state of broadband service in their area. In every case, communities come to M-Lab because of the openness of our data. C...Thu, 28 Mar 2019 00:00:00 GMTBroadbandCommunitySpeedMappinghttps://measurementlab.net/blog/speed-tests-accuracy/https://measurementlab.net/blog/speed-tests-accuracy/‘How fast is my Internet?’ It seems like a simple question, but in fact there are several ways to approach the question and no one correct way to answer it. Given that there are so many different methods used to measure Internet speed, it’s not surprising that we get emails asking about peopl...Tue, 26 Mar 2019 00:00:00 GMTSpeedAccuracyhttps://measurementlab.net/blog/mlab-20-platform-migration-update/https://measurementlab.net/blog/mlab-20-platform-migration-update/Last year, we outlined our plans to [Modernize the M-Lab Platform][modernize]. This year, we’re bringing them to life. Here’s a summary of why the platform update is so valuable and what you can expect throughout the year. [modernize]: /blog/modernizing-mlabTue, 12 Mar 2019 00:00:00 GMTPlatformResearchDataKernelOpen SourcePerformanceTCP_INFOhttps://measurementlab.net/blog/mlab-hiring/https://measurementlab.net/blog/mlab-hiring/Hello M-Lab Community! TLDR; Interested in working with M-Lab? We are hiring a Project Director and have opportunities for contracts! Check out the job description and more information about the contract, and apply by March 31st!Mon, 04 Mar 2019 00:00:00 GMTCommunityhttps://measurementlab.net/blog/africomm-afrinic/https://measurementlab.net/blog/africomm-afrinic/AFRICOMM 2018. Left to right: Amreesh Phokeer (AFRINIC), Josiah Chavula (University of Capetown), Georgia Bullen (M-Lab), Antoine Delvaux (perfSonar), Stephen Soltesz (M-Lab). In late November 2018, M-Lab was invited to the Internet Measurement Workshop at AFRINIC-29 in Tuni...Fri, 01 Mar 2019 00:00:00 GMTEventCommunityBigqueryResearchDataParis Traceroutehttps://measurementlab.net/blog/mlab-announcement/https://measurementlab.net/blog/mlab-announcement/Code for Science & Society (CS&S) and New America’s Open Technology Institute are excited to announce that Measurement Lab (M-Lab) is joining CS&S’s Sponsored Projects Program on March 1 after a decade of growth at New America. Measurement Lab has been working in the public interest to measure In...Thu, 28 Feb 2019 00:00:00 GMTCommunityhttps://measurementlab.net/blog/internet-preformance-igf/https://measurementlab.net/blog/internet-preformance-igf/In this blog post I’ll share the slides I presented in a session at the 2018 Internet Governance Forum (IGF) titled Net Neutrality: "Measuring Discriminatory Practices", along with some extra comments that occurred to me after delivering the talk, when preparing this follow-up bl...Tue, 12 Feb 2019 00:00:00 GMTIGFEventhttps://measurementlab.net/blog/retiring-neubot-client/https://measurementlab.net/blog/retiring-neubot-client/Neubot hasn’t been updated in a while, but, we decided to keep it available because there were still many active users. Now the time has come to say goodbye to the Neubot client, because too much time has passed since the latest release. We recommend all user...Fri, 11 Jan 2019 00:00:00 GMTNeubothttps://measurementlab.net/blog/pt-bug-remediation/https://measurementlab.net/blog/pt-bug-remediation/In December 2017, M-Lab was notified of oddities in the Paris Traceroute data, which we then wrote about in January 2018. Upon investigation, a bug in the Paris Traceroute code was identified. The bug caused bad measurement data in 2.7% of the traceroutes since July 2016.Mon, 12 Nov 2018 00:00:00 GMTParis TracerouteBugPlatformhttps://measurementlab.net/blog/mlab-at-sigcomm-2018-wrapup/https://measurementlab.net/blog/mlab-at-sigcomm-2018-wrapup/M-Lab had the pleasure of attending the first ever SIGCOMM hackathon on August 25, 2018, at the Nokia Skypark headquarters in Budapest, Hungary. The hackathon, sponsored by Nokia, DECIX, and Netflix, invited network research faculty, students, and industry professionals from around the world to f...Thu, 25 Oct 2018 00:00:00 GMTEventCommunityBigqueryResearchDataPerformancehttps://measurementlab.net/blog/mlab-10year-wrapup/https://measurementlab.net/blog/mlab-10year-wrapup/We’ve reached a point in human history where, for many of us, the Internet has become a standard presence in our daily lives. In the United States, the Internet is simply part of how many of us engage with the world. In other countries (and parts of this one), the Internet remains unaffordable, u...Fri, 19 Oct 2018 00:00:00 GMTEventCommunityBigqueryResearchDataPerformancehttps://measurementlab.net/blog/switch-discards-redux/https://measurementlab.net/blog/switch-discards-redux/On February 1st, 2018, during a regular data quality review, we identified an increase in switch discards at sites with 10Gbps equipment connected to 1Gbps uplinks. We used our switch telemetry data to assess whether there were any negative consequences for tests contained in our SideStream or ND...Mon, 10 Sep 2018 00:00:00 GMTDataData AnalysisBigqueryResearchMicroburstsSwitch DiscardPerformancehttps://measurementlab.net/blog/mlab-at-sigcomm2018/https://measurementlab.net/blog/mlab-at-sigcomm2018/When: Saturday, August 25, 2018 Where: SIGCOMM, Budapest, Hungary M-Lab will be at this year's SIGCOMM hackathon in Budapest, Hungary. Check out the projects we're hoping to work on with folks on the hackathon wiki.Wed, 25 Jul 2018 00:00:00 GMTEventCommunityBigqueryResearchDataPerformancehttps://measurementlab.net/blog/mlab-10year/https://measurementlab.net/blog/mlab-10year/When: Aug. 7, 2018 - Aug. 8, 2018, 9AM - 5PM Where: New America, 740 15th St NW 900, Washington, D.C. 20005 Measurement Lab is turning 10! On August 7 and 8, we look forward to gathering the Measurement Lab community to showcase how the platform has evolved, learn from you about how ...Sat, 21 Jul 2018 00:00:00 GMTEventCommunityBigqueryResearchDataPerformancehttps://measurementlab.net/blog/disco-dataset/https://measurementlab.net/blog/disco-dataset/Since June 2016, M-Lab has collected high resolution switch telemetry for each M-Lab server and site uplink. Originally designed to detect switch discards from [server traffic microbursts][microbursts], we now support the DIScard COllection (a.k.a. DISCO) dataset as a standard M-Lab BigQuery ...Fri, 20 Jul 2018 00:00:00 GMTDataData AnalysisBigqueryResearchMicroburstsSwitch DiscardPerformancehttps://measurementlab.net/blog/murakami/https://measurementlab.net/blog/murakami/The Measurement Lab team has always tried to make it as easy as possible to run network measurements. Currently, most users run tests either directly from the M-Lab website, or through a 3rd party integration. Over the years, many users have requested the ability to run tests on a regular basis, ...Thu, 05 Apr 2018 00:00:00 GMTDataOpen SourceResearchhttps://measurementlab.net/blog/etl-pipeline/https://measurementlab.net/blog/etl-pipeline/Since May 2017, the M-Lab team has been working on an updated, open source pipeline, which pulls raw data from our servers, saves it to Google Cloud Storage, and then parses it into our BigQuery tables. The team is particularly excited about this update because it means that the pipeline no longe...Fri, 09 Feb 2018 00:00:00 GMTPipelineBigqueryVersioninghttps://measurementlab.net/blog/modernizing-mlab/https://measurementlab.net/blog/modernizing-mlab/When the M-Lab platform was initially launched in 2009, the software and operating system running on our servers used the best available boot management, virtualization, and kernel-level measurement instrumentation available. In the years since M-Lab’s initial launch, the state of system administ...Wed, 24 Jan 2018 00:00:00 GMTUpgradesVirtualizationKernelTCP_INFOBBRWeb100Platformhttps://measurementlab.net/blog/pt-bug/https://measurementlab.net/blog/pt-bug/In December 2017, M-Lab was notified of oddities in the Paris Traceroute data. Upon investigation, a bug in the Paris Traceroute code was identified. The bug caused bad measurement data in 2.7% of the traceroutes since July 2016.Wed, 24 Jan 2018 00:00:00 GMTParis TracerouteBugPlatformhttps://measurementlab.net/blog/interconnection_update/https://measurementlab.net/blog/interconnection_update/Introduction As a platform committed to producing empirical data for the public, Measurement Lab (M-Lab) has historically supplied regulators and other governmental entities with technical facts pertinent rule-making processes. In our February 2015 submission to the FCC’s Open Internet docket,...Wed, 09 Aug 2017 00:00:00 GMTInterconnectionResearchObservatoryDataData AnalysisResearchhttps://measurementlab.net/blog/transitioning-data-pipeline/https://measurementlab.net/blog/transitioning-data-pipeline/M-Lab data is collected from distributed experiments hosted on servers all over the world, processed in a pipeline, and published for free in both raw and parsed (structured) formats. The back end processing component for this has served us well for many years, but it's been showing its age recen...Tue, 02 May 2017 00:00:00 GMTBigqueryDataData AnalysisGCSPerformancePipelineResearchPlatformhttps://measurementlab.net/blog/paris-traceroute-brownout/https://measurementlab.net/blog/paris-traceroute-brownout/Summary: In February 2017, M-Lab was notified of issues with the M-Lab data available in BigQuery. Upon investigation, a problem was identified with the Paris Traceroute collection daemon which resulted in a reduction in Paris Traceroute measurements beginning in June 2016. At the peak of the ...Sun, 09 Apr 2017 00:00:00 GMTDataParis TraceroutePlatformhttps://measurementlab.net/blog/new-dataviz-site/https://measurementlab.net/blog/new-dataviz-site/The Measurement Lab (M-Lab) global measurement platform contains the largest collection of open Internet performance data on the planet. Hundreds of thousands of people (and rising everyday!) test their Internet connections on M-Lab and provide that data to the public domain for research, analysi...Tue, 07 Mar 2017 00:00:00 GMTDataVisualizationhttps://measurementlab.net/blog/tcp-and-bbr/https://measurementlab.net/blog/tcp-and-bbr/What is TCP? Since the beginning of the its existence, the Internet has expanded in scope, traffic, content, and a myriad of other ways. The protocols that make up the Internet’s backbone have mostly remained the same since they were developed in the 1980s. The Transmission Control Protocol (T...Wed, 30 Nov 2016 00:00:00 GMTTCPBBRTraffic Congestionhttps://measurementlab.net/blog/showing-missing-data-in-line-charts/https://measurementlab.net/blog/showing-missing-data-in-line-charts/The M-Lab team has been working with Bocoup’s Data Visualization team to overhaul our visualizations and give all of you better support in exploring all of the Measurement Lab data. Look for more about that soon -- and reach out via support@measurementlab.net if you are interested in helping with...Tue, 04 Oct 2016 00:00:00 GMTDataVizVisualizationObservatoryDataOpen Sourcehttps://measurementlab.net/blog/traffic-microbursts-and-their-effect-on-internet-measurement/https://measurementlab.net/blog/traffic-microbursts-and-their-effect-on-internet-measurement/In August 2015, M-Lab was notified of potential degradation of site performance by a measurement partner based on discrepancies compared to results for their own servers. After a full investigation these patterns were found to have been caused by the unique confluence of several specific conditio...Wed, 25 May 2016 00:00:00 GMTMicroburstsSwitch DiscardPerformanceDataPlatformhttps://measurementlab.net/blog/new-tables-release/https://measurementlab.net/blog/new-tables-release/In January, M-Lab launched a beta test of new BigQuery tables for M-Lab data. Today, M-Lab is pleased to announce that the beta test was successful. The new, faster-performing tables will be M-Lab's new standard BigQuery tables. Before we move on to specifics, when we say faster performing, we me...Thu, 17 Mar 2016 00:00:00 GMTBigqueryGCSPerformanceDatahttps://measurementlab.net/blog/bigquery-performance-improvements/https://measurementlab.net/blog/bigquery-performance-improvements/Today, M-Lab is happy to announce the public beta of new M-Lab BigQuery tables. These tables provide substantially improved performance and reduce the difficulty of writing BigQuery SQL.Tue, 19 Jan 2016 00:00:00 GMTBigqueryPerformanceDatahttps://measurementlab.net/blog/interconnection_and_measurement_update/https://measurementlab.net/blog/interconnection_and_measurement_update/In late April, Internet2, with contributions from M-Lab developers, released an updated version of the Network Diagnostic Tool (NDT), M-Lab’s most widely deployed performance measurement test. In addition to improved stability, the updated version of NDT makes it possible to measure network perfo...Wed, 24 Jun 2015 00:00:00 GMTConsumer InternetData AnalysisInterconnectionObservatoryOpen SourceResearchTransparencyVisualizationhttps://measurementlab.net/blog/data_duplication_writeup/https://measurementlab.net/blog/data_duplication_writeup/The team working on archiving M-Lab data recently discovered that the M-Lab data hosted in BigQuery was affected by a bug that caused duplicates to appear in our dataset. Queries against M-Lab’s BigQuery dataset performed between May 2014 and April 2015 were impacted. The raw files in our Google ...Fri, 24 Apr 2015 00:00:00 GMTDataTransparencyhttps://measurementlab.net/blog/internet_observatory_update/https://measurementlab.net/blog/internet_observatory_update/Last October, Measurement Lab released the Internet Observatory, a data-visualization tool that enables consumers, policymakers, and researchers to better understand the impact of ISP relationships on Internet access and performance. The Observatory provides easier access to M-Lab’s rich dataset ...Thu, 12 Feb 2015 00:00:00 GMTInterconnectionResearchObservatoryhttps://measurementlab.net/blog/mlab-ripe/https://measurementlab.net/blog/mlab-ripe/On Thursday Nov. 6, Collin Anderson gave a talk at the RIPE meeting in London. Collin has been immersed in the M-Lab data for some time, and helped lead the recently published technical report, ISP Interconnection and its Impact on Consumer Internet Perform...Mon, 10 Nov 2014 00:00:00 GMTInterconnectionResearchRIPEhttps://measurementlab.net/blog/observatory-new-features/https://measurementlab.net/blog/observatory-new-features/We launched the M-Lab Internet Observatory last week to provide a window into ISP performance, letting people see how ISPs in the US are doing compared to each other, and to view the way in which the connections between ISPs impact performance. We will be releasing additional features and views a...Mon, 03 Nov 2014 00:00:00 GMTObservatoryFeaturesVisualizationhttps://measurementlab.net/blog/research_update1/https://measurementlab.net/blog/research_update1/Prior to the publication of our recent report, ISP Interconnection and its Impact on Consumer Internet Performance, we shared review copies with members of the research community, broadening the set of eyes on our methods and challenging our assertions. We received valuable feedback that allowed ...Fri, 31 Oct 2014 00:00:00 GMTResearchToSInterconnectionhttps://measurementlab.net/blog/2014_interconnection_report/https://measurementlab.net/blog/2014_interconnection_report/We are happy to announce the release of a long-term collaborative research effort using M-Lab's data to understand how interconnection impacts end-user performance. The report, ISP Interconnection and its Impact on Consumer Internet Performance examines years of network measurement...Tue, 28 Oct 2014 00:00:00 GMTResearchInterconnectionConsumer InternetPerformancehttps://measurementlab.net/blog/mlab_asb2014/https://measurementlab.net/blog/mlab_asb2014/The Open Technology Institute hosted students from the Graduate School of Information at the University of Michigan, Ann Arbor, March 3-7, 2014 for an Alternative Spring Break program. Two students met with key internal staff interested using M-Lab data to help answer broad research...Mon, 10 Mar 2014 00:00:00 GMThttps://measurementlab.net/blog/gsoc_2014/https://measurementlab.net/blog/gsoc_2014/We are proud to announce that the M-Lab has been accepted as a mentoring organization to the Google Summer of Code a third year in a row.Fri, 07 Mar 2014 00:00:00 GMTGSOCOpen Sourcehttps://measurementlab.net/blog/assessing_haiyans_impact/https://measurementlab.net/blog/assessing_haiyans_impact/Typhoon Haiyan was a tragedy, and its human and ecological impact rightly deserve the bulk of our attention and concern. Keeping this in mind, we are gratified to see the Internet Researchers at RIPE NCC using open Internet measurement data to analyze the health of Philippines' core Internet infr...Wed, 27 Nov 2013 00:00:00 GMTData AnalysisRIPEhttps://measurementlab.net/blog/ripestat_mlab_widgets/https://measurementlab.net/blog/ripestat_mlab_widgets/Are you the kind of person who wonders… - What’s the bandwidth distribution among Internet users within a specific country or network? - How are active users of a specific network geographically spread? - How are active users spread within a specific IP address block?Mon, 30 Sep 2013 00:00:00 GMTVisualizationData AnalysisRIPEhttps://measurementlab.net/blog/welcome_to_the_same_old_m_lab/https://measurementlab.net/blog/welcome_to_the_same_old_m_lab/If it looks like you knocked on the wrong door, that's us, not you. Welcome to the new M-Lab website! After years of directing our energy and resources toward expanding our measurement platform and furthering the state of open network research, we finally got around to redecorating. We hope that ...Mon, 05 Aug 2013 00:00:00 GMT