Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/HTTPArchive/legacy.httparchive.org

<<THIS REPOSITORY IS DEPRECATED>> The HTTP Archive provides information about website performance such as # of HTTP requests, use of gzip, and amount of JavaScript. This information is recorded over time revealing trends in how the Internet is performing. Built using Open Source software, the code and data are available to everyone allowing researchers large and small to work from a common base.
https://github.com/HTTPArchive/legacy.httparchive.org

increase Android and Chrome to 5000 URLs

d87ca24a693a0f7f8ac35d6fbb43b238ae3991e4 authored over 9 years ago by Steve Souders <github@souders.org>
tweak message to not mislead that things are copied to production - that only happens for IE8 from dev to prod

1178cb571abaa50ccf9e852e0c2be41f61e3cd17 authored over 9 years ago by Steve Souders <github@souders.org>
fix device name for Chrome

33b904b549e13925fd3f17f39b2bffe53cce2641 authored over 9 years ago by Steve Souders <github@souders.org>
fix bug for default device

97d56cbc420478175ae3bb46f537c48ac7ab81bb authored over 9 years ago by Steve Souders <github@souders.org>
change emulation to android

9f0eb615cd190dcfdd692b41e12f31b71cff6281 authored over 9 years ago by Steve Souders <github@souders.org>
change emulation to android

a69210b4793299ce2b61e1682fb7e1cdd66b523e authored over 9 years ago by Steve Souders <github@souders.org>
change emulation to android

dc036790dd257a34963088590f4018a64eba35ab authored over 9 years ago by Steve Souders <github@souders.org>
change emulation to android

e213330e101e4dc96253d1660b4a50a35ac68de5 authored over 9 years ago by Steve Souders <github@souders.org>
change emulation to android

20e368de6418ea803db9105b9fcea58ee73ba18b authored over 9 years ago by Steve Souders <github@souders.org>
add chrome & emulation

c2a97aa205561d72453455cdc73028f6fa5a17e9 authored over 9 years ago by Steve Souders <github@souders.org>
add chrome & emulation

6ef840ccb30941e3a89efd0fb432c039111bd9fa authored over 9 years ago by Steve Souders <github@souders.org>
remove stray global

f83a58a4614a363199e362d025499c9dff7abfd1 authored over 9 years ago by Steve Souders <github@souders.org>
clean up stray global

c86c90be9cbbcb6bee0d19db2ed93ac0df67c19e authored over 9 years ago by Steve Souders <github@souders.org>
add chrome & emulation

5fded72438323d3d03ad79a18209eaec37bd91c1 authored over 9 years ago by Steve Souders <github@souders.org>
add chrome & emulation

d22855cc2734161378ec409bc3980389dc78fdc3 authored over 9 years ago by Steve Souders <github@souders.org>
add chrome & emulation

d2a4d34ed37886a53d186e5db8fe1ba27130b43a authored over 9 years ago by Steve Souders <github@souders.org>
add chrome & emulation

57a3c7815b7c51e53a9e3f1ada50c7afe7fc54f7 authored over 9 years ago by Steve Souders <github@souders.org>
add chrome & emulation

4ce9f276daf89a52948e67d484d6964c15e3b35e authored over 9 years ago by Steve Souders <github@souders.org>
new high res log - thanks Stephen!

b24f18e1f910ba04d86c967a604ec3bcafd8d8b1 authored almost 10 years ago by Steve Souders <github@souders.org>
Increase from 300K to 500K URLs. Break up a huge delete command because we kept hanging

999a263a79cdc0626fae69347185e76af03bff3e authored almost 10 years ago by Steve Souders <github@souders.org>
increase the # of passes from 2 to 3 - this catches a few percent more errors

32e0ca984a4e49857c234473b2cc3ab08ef8febd authored almost 10 years ago by Steve Souders <github@souders.org>
cleanup error messages a bit

2631bb77fd7c32e2d9f2502bad7065d014b763ad authored almost 10 years ago by Steve Souders <github@souders.org>
restrict access to batch_errors.php too

fe42cbf58d0666952dff35781dc821a3557b4a27 authored almost 10 years ago by Steve Souders <github@souders.org>
add $bFinished param so we can ignore unfinished crawls

f4777c7576fead2164423d01acfc205b042fd798 authored almost 10 years ago by Steve Souders <github@souders.org>
mention 1st and 15th are dates of crawls

b99bb7d2df848e339df5d4f652465f30aefb5031 authored almost 10 years ago by Steve Souders <github@souders.org>
Replace TRUNCATE with ROUND while preserving 1 decimal place. This avoids TWO truncation errors! For some reason, MySQL was truncated "1.8" to "1.7".

d75a531c53c1a72346d9dec7b9194d39922677f8 authored about 10 years ago by Steve Souders <github@souders.org>
For Ilya so he can track the status of the crawl and get the necessary info to import to BigQuery.

5c92b49254879db80d5a5c692f9518d6e2dee380 authored about 10 years ago by Steve Souders <github@souders.org>
better error checking

b2a761dc0cba6aeffee408c0b494c6e600482bfe authored about 10 years ago by Steve Souders <github@souders.org>
add link to bigquery faq

e06fc5f6a63b5a6121faed987492603f1fbb62d4 authored about 10 years ago by Steve Souders <github@souders.org>
add link to bigquery faq

949b92d57d13cf641a3d5f5e1a19277d20527a52 authored about 10 years ago by Steve Souders <github@souders.org>
mention bigqueri.es

c8a54ff9515aabe9a82c11044a070ed1335cc738 authored about 10 years ago by Steve Souders <github@souders.org>
commented out links to referers

b6148a95934a2a8d9609f4d0d1186f9acc2eae4a authored about 10 years ago by Steve Souders <github@souders.org>
add link to bigquery faq

cf5ef9a658624e119fb3db0588e62ffa7dc7ebda authored about 10 years ago by Steve Souders <github@souders.org>
add bigquery faq

0609fc972e030390e8b135d8c1e204b39839c1a3 authored about 10 years ago by Steve Souders <github@souders.org>
include crawlid in stats

325221d5c284c1cb60900310e305cb7755ff68c8 authored over 10 years ago by Steve Souders <github@souders.org>
include crawlid in stats

0b9f4fcd72b966a8f4732d2fcc0dd495ad7cd1e2 authored over 10 years ago by Steve Souders <github@souders.org>
remove cachegen.php - no longer used

d73f30277f7b6807ff4c657f046b84aadcfde13b authored over 10 years ago by Steve Souders <github@souders.org>
add suffix for bytesOther

5062fec2d4a077751869e7cfcff7210428f39d38 authored over 10 years ago by Steve Souders <github@souders.org>
space out labels for long trend charts

d377ffd9bfa420d05041c955a762c27b4c506538 authored over 10 years ago by Steve Souders <github@souders.org>
tweak

eb89adf52fff59e1337a02f076b840807d24f8ac authored over 10 years ago by Steve Souders <github@souders.org>
fix bug where the SECOND site label select list should NOT have an onchange handler

1c2d53cc0cc1991f0181d9e084a417291db75b85 authored over 10 years ago by Steve Souders <github@souders.org>
make the PLT chart available for individual websites

318675c0ee6d917475db4bfcc61b6bfc9faf6adf authored over 10 years ago by Steve Souders <github@souders.org>
crontab for HTTP Archive

6b24ef81f79bc6530f894b6332b873c72a52cc25 authored over 10 years ago by Steve Souders <github@souders.org>
strip bad chars from result

4f40ffd57d96bf48a221d1e3cfaf394445a7ffb8 authored over 10 years ago by Steve Souders <github@souders.org>
strip bad chars from result

8028fa773389133bf6be48e4a3e34e3149dfbdc7 authored over 10 years ago by Steve Souders <github@souders.org>
fix typo in column name

ee4a2da1fb0a5824b7ba3b72df2a04cd347389a7 authored over 10 years ago by Steve Souders <github@souders.org>
wow - interesting bug. Pat fixed the WPT code so that it sent headersSize, which uncovered this bug where I misspelled the column

17ca7da3c57a9ff4a8f0485d3bfc9b55a86477e0 authored over 10 years ago by Steve Souders <github@souders.org>
add code to compute CDF stats. this will happen as part of computeStats() at the end of every crawl

b38796231bbe1c9ea4eb1d1654a369108917ed1d authored over 10 years ago by Steve Souders <github@souders.org>
add CDF table

d1407c330507bed596e3bcb11042c2c8feb0dbe5 authored over 10 years ago by Steve Souders <github@souders.org>
open link in new window icon

62d6ff8a0aae3d296e28ac510a22a1be8a197ab6 authored over 10 years ago by Steve Souders <github@souders.org>
Fastly sponsor logo

ba12faf44a27cc1b0142c67fc05515f39380b983 authored over 10 years ago by Steve Souders <github@souders.org>
remove redirects

4727de0a537eec8debcc04ee5d25250ea1de5f41 authored over 10 years ago by Steve Souders <github@souders.org>
add Fastly

b071e2b8ef657d5ae631f3a57c5350823121e7a7 authored over 10 years ago by Steve Souders <github@souders.org>
add Fastly

5d3ed5095886e7b6418efd272f017c4554c17d19 authored over 10 years ago by Steve Souders <github@souders.org>
Add help snippets for new charts

08f052c45c86d5f244588a75eb07a7b7e85407bf authored over 10 years ago by Steve Souders <github@souders.org>
mention one URL per domain

03112d255d183174722aeceafa6f9965213c61bb authored over 10 years ago by Steve Souders <github@souders.org>
center charts on front page

96208b7414524be5b8635cff0d94e071e0b63ff4 authored over 10 years ago by Steve Souders <github@souders.org>
remove Alpha from mobile version

f5277443e86c2b8c91755cefb07f9a3fe6fa91c3 authored over 10 years ago by Steve Souders <github@souders.org>
uppercase

089ed12f1a69114b76396a1f3370f1f676e33bc1 authored over 10 years ago by Steve Souders <github@souders.org>
remove carriage return because it breaks index.php insert

e0882cf56224071df0c3acb9d15b3a464c5fe246 authored over 10 years ago by Steve Souders <github@souders.org>
remove numRedirects for now until histograms are finished

cbb33933135265432047c88b43ba025de8ffcf7e authored over 10 years ago by Steve Souders <github@souders.org>
save crawlid with requests

16d641686839ee54a84b5f697afdd3b4fc713e3e authored over 10 years ago by Steve Souders <github@souders.org>
use new $hCdf data structure based on "cdf" table

33d6455d1d4104de5dc2bc7f19fc089beaead752 authored over 10 years ago by Steve Souders <github@souders.org>
add function getCdfData. extend getStatsData() to include cdf data.

eebb45ee4c617d53013a2db861b707905c56b1af authored over 10 years ago by Steve Souders <github@souders.org>
add crawlid to requests table. evenutally we should create an index on it probably

06a14ea079da2464b8fc7795fa6c279719be8829 authored over 10 years ago by Steve Souders <github@souders.org>
remove old histogram function. Now histogram() relies on the cdf table. Add a check to histogram to avoid crawls that have no data.

0833da1177d6361609e7c1b958d19b9a6933e343 authored over 10 years ago by Steve Souders <github@souders.org>
add histograms

234847eaae782a01ec37a4146f8c2b32cdae3359 authored over 10 years ago by Steve Souders <github@souders.org>
add pickColor(). use number_format instead of commaize

f4acd65505a2be40133f31afd5ef01563d112b35 authored over 10 years ago by Steve Souders <github@souders.org>
_connections chart not available on mobile

7191d06cdccd19965ea1b16c9d8b7cc58e19539a authored over 10 years ago by Steve Souders <github@souders.org>
since charts are different widths now, align them left

f9061fb940ee742fca77f80740c876e839fb0942 authored over 10 years ago by Steve Souders <github@souders.org>
replace redirects with histogram

aad2ddeca8d73d8d0dfb395228723b1f61fd13a9 authored over 10 years ago by Steve Souders <github@souders.org>
BIG: Add new functions cdf() & histogram(). Add pickColor to pick colors randomly in a deterministic way (?!). This code is still being finalized (hence histogram() and histogram2() where we are figuring out how to cache the data in stats table).

915eea08ffb4f25110c50bf31c21c1c3ec4a5ffc authored over 10 years ago by Steve Souders <github@souders.org>
use WebPagetest compare capability

ebdad3654a68af7bb7a174e62ec0fff3c2f47e72 authored over 10 years ago by Steve Souders <github@souders.org>
only use pageid to find search results (URL is unnecessary and clutter)

cce3a7c8ea164304e04241f534a13067f8e771b0 authored over 10 years ago by Steve Souders <github@souders.org>
use new _adult_site field to identify adult content websites

7b69ad7f67a73d3c471e373552428943f05ada6b authored over 10 years ago by Steve Souders <github@souders.org>
use new _adult_site field to identify adult content websites

aab8219b9094311ee2f45eee4975a2c79b99577d authored over 10 years ago by Steve Souders <github@souders.org>
add comment

c65553a56e4de8abee4423541aaec9c1786cfe3b authored over 10 years ago by Steve Souders <github@souders.org>
use new _adult_site field to identify adult content websties

7903a209a3f92cecfb298afce42782db039baade authored over 10 years ago by Steve Souders <github@souders.org>
nit change comment

5b740fd0dcf13372ad2811f59ddd54f3f0b65e9e authored over 10 years ago by Steve Souders <github@souders.org>
Add function latestCrawlId(). Add TODO notes of deprecated code for when we were thinking about multiple requests merge tables.

84a21e357d01bca72738e24a8c18b66577ef73a7 authored over 10 years ago by Steve Souders <github@souders.org>
Abandon idea of doing request merge tables. It will not work well for private instances.

b2a2c12294d4de3f3a5615755199adb9294bddbc authored over 10 years ago by Steve Souders <github@souders.org>
add error checking for custom_metrics and other optional HAR fields

ac06fcd77353df240f20d6b66c5ddb99c772e5da authored over 10 years ago by Steve Souders <github@souders.org>
add "push" target as we start doing crawls from main dir

82c5e037163ababecf6fcfadd7d487f03e628453 authored over 10 years ago by Steve Souders <github@souders.org>
custom_metrics!

cb1985438b6869fbf2c19fe9750595c29f1f0415 authored over 10 years ago by Steve Souders <github@souders.org>
add Gzip Savings column to the table of requests

cfb66e2c0a3e585ee0e597a1a755dbc6b976fe8a authored over 10 years ago by Steve Souders <github@souders.org>
get _gzip_save column

d043d825d7b3a3facad53d47faa47c12f955bc91 authored over 10 years ago by Steve Souders <github@souders.org>
add new columns to pages and stats based on custom_metrics

8033147c85b2ab3ccbe2399b648025fdfc2cb83b authored over 10 years ago by Steve Souders <github@souders.org>
add new columns to pages and stats based on custom_metrics

5a5637e641420ae4d407ffc26028f286b456dd81 authored over 10 years ago by Steve Souders <github@souders.org>
add new columns to pages and stats based on custom_metrics

36bfe81923afb8570506ae9d536c8ac7344a14a3 authored over 10 years ago by Steve Souders <github@souders.org>
add pushmetrics

4f522d6d48eb36c2e0c44e963b40743b1659e1f9 authored over 10 years ago by Steve Souders <github@souders.org>
whitespace?

ad132f90729daeb3ec2170c3db1ee1056b70b23a authored over 10 years ago by Steve Souders <github@souders.org>
extract new columns

79747ea218ef19f94081c71b7b91ff2b42ad35b5 authored over 10 years ago by Steve Souders <github@souders.org>
add a link to mobile, and vice-versa

0883acab22371bcfdf51c0f82ec86cade348730a authored over 10 years ago by Steve Souders <github@souders.org>
add an option to NOT skip labels for Mark Zeman

6c4ab46324850fa1be482b639a282333a1a4ab92 authored over 10 years ago by Steve Souders <github@souders.org>
remove formatting for label select list

c1e0b27e46804d43c9833d86c3c200b5a33b8937 authored over 10 years ago by Steve Souders <github@souders.org>
Add options to specify the select list onchange code and to select the NEXT crawl by default.

b7ecce769e7fbf52398759a6976fe5ddc2b4c50e authored over 10 years ago by Steve Souders <github@souders.org>
Add ability to compare two dates.

176c9cee5c43487c96dbcae28067a07dc15bf919 authored over 10 years ago by Steve Souders <github@souders.org>
Mention Ilya exporting the data to BigQuery. Improve instructions.

c994a8b2792a38504588044772fce675461f2d05 authored over 10 years ago by Steve Souders <github@souders.org>
add _adult_site column

00bb78dbd1f290a439ecd590dcd4f9c4f142c1aa authored over 10 years ago by Steve Souders <github@souders.org>
add &pretty=1 to HAR file export

d0584d44c9468ac02b151b89118a4491283df2fc authored over 10 years ago by Steve Souders <github@souders.org>