Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.X.......................] duration: 1.958929427s FAIL (2025-08-12 13:27:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.958954544s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........................X.......X.........X...X...........] duration: 5.920725854s FAIL (2025-08-12 13:26:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 5.920777505s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.X......................] duration: 1.92415932s FAIL (2025-08-12 13:26:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.924191371s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........................X.......X.........X...X..........] duration: 5.949374193s FAIL (2025-08-12 13:26:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 5.949401136s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.X.....................] duration: 2.028661437s FAIL (2025-08-12 13:26:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.028686165s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.X....................] duration: 1.99448138s FAIL (2025-08-12 13:25:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.994505477s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................X.......X.........X...X.........] duration: 5.726002966s FAIL (2025-08-12 13:25:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 5.726027102s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.X...................] duration: 2.070289183s FAIL (2025-08-12 13:24:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.070317127s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.X..................] duration: 1.971466463s FAIL (2025-08-12 13:24:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.971489587s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................X.......X.........X...X........] duration: 5.980240718s FAIL (2025-08-12 13:24:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 5.980266978s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.X.................] duration: 2.056412363s FAIL (2025-08-12 13:23:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.056444134s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................X.......X.........X...X.......] duration: 6.076619363s FAIL (2025-08-12 13:23:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 6.076646948s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.X................] duration: 1.850581041s FAIL (2025-08-12 13:23:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.850609665s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.X...............] duration: 1.900695622s FAIL (2025-08-12 13:22:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.900732854s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 9.238244376s FAIL (2025-08-12 13:22:22 UTC) orbiter warning: context deadline exceeded Duration: 9.238270194s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............................X.......X.........X...X......] duration: 6.420616363s FAIL (2025-08-12 13:22:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 6.420643184s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 8.612052584s FAIL (2025-08-12 13:21:56 UTC) orbiter warning: context deadline exceeded Duration: 8.61207189s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.X..............] duration: 1.991358936s FAIL (2025-08-12 13:21:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.991389252s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 7.910957048s FAIL (2025-08-12 13:21:22 UTC) orbiter warning: context deadline exceeded Duration: 7.910971657s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.X.............] duration: 2.212641173s FAIL (2025-08-12 13:21:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.212677733s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................................X.......X.........X...X.....] duration: 5.939591052s FAIL (2025-08-12 13:21:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 5.939614938s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 8.615358281s FAIL (2025-08-12 13:21:01 UTC) orbiter warning: context deadline exceeded Duration: 8.615402405s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................................X.......X.........X...X....] duration: 5.84328273s FAIL (2025-08-12 13:20:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 5.84331362s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.X............] duration: 2.237010838s FAIL (2025-08-12 13:20:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.237035947s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 8.08225751s FAIL (2025-08-12 13:19:53 UTC) orbiter warning: context deadline exceeded Duration: 8.082280744s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................................X.......X.........X...X...] duration: 5.920610391s FAIL (2025-08-12 13:19:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 5.920633044s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 7.74814538s FAIL (2025-08-12 13:19:22 UTC) orbiter warning: context deadline exceeded Duration: 7.748175256s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X.X...........] duration: 2.09030377s FAIL (2025-08-12 13:19:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.09032985s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X.X..........] duration: 1.890852554s FAIL (2025-08-12 13:18:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.890875147s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................................X.......X.........X...X..] duration: 6.141623771s FAIL (2025-08-12 13:18:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 6.141650603s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.....X.....................................................] duration: 8.285190894s FAIL (2025-08-12 13:18:20 UTC) orbiter warning: context deadline exceeded Duration: 8.285211672s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.....X....................................................] duration: 8.273119276s FAIL (2025-08-12 13:18:00 UTC) orbiter warning: context deadline exceeded Duration: 8.273148392s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................................X.......X.........X...X.] duration: 6.278003696s FAIL (2025-08-12 13:17:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 6.278030728s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................................X.X.........] duration: 2.078663903s FAIL (2025-08-12 13:17:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.078686185s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.....X...................................................] duration: 10.307301135s FAIL (2025-08-12 13:17:07 UTC) orbiter warning: context deadline exceeded Duration: 10.307323519s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X.X........] duration: 1.929350931s FAIL (2025-08-12 13:16:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.929369718s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X.X.......] duration: 1.930723689s FAIL (2025-08-12 13:16:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.930741563s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................................X.......X.........X...X] duration: 6.038896906s FAIL (2025-08-12 13:16:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c42de51508748435af35ebd4e3ce621e55814fbabc94723fbce1c1389a46360f != before 1164ce89329cbbd642ae88ed99bac8f324dc71d7c998f3224fb96cf1b5ebce48 ======LOGS====== Aug 12 13:16:22.939700717 (91h50m17.370780848s) [upload=95700]: Starting upload Aug 12 13:16:22.939757696 (91h50m17.370837817s) [upload=95700]: Done starting upload Aug 12 13:16:22.939922602 (91h50m17.371002733s) [upload=95700]: Uploading segments... Aug 12 13:16:22.939951337 (91h50m17.371031468s) [upload=95700]: Got next segment. Inline: false Aug 12 13:16:22.939975212 (91h50m17.371055343s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:16:22.939979621 (91h50m17.371059752s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:16:23.394579806 (91h50m17.825659937s) [seg_pos={0 0}, upload=95700]: Begin upload segment... Aug 12 13:16:23.394633237 (91h50m17.825713368s) [seg_pos={0 0}, upload=95700]: Done begin upload segment. Aug 12 13:16:23.394654769 (91h50m17.8257349s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.394689766 (91h50m17.825769897s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395031830 (91h50m17.826111961s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395273573 (91h50m17.826353704s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395365278 (91h50m17.826445409s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395641056 (91h50m17.826721187s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.395904821 (91h50m17.826984952s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396116816 (91h50m17.827196947s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396334813 (91h50m17.827414944s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396601343 (91h50m17.827681474s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.396818349 (91h50m17.82789848s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397015275 (91h50m17.828095396s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397202774 (91h50m17.828282905s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397389111 (91h50m17.828469242s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.397640111 (91h50m17.828720242s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.398487793 (91h50m17.829567924s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.399027806 (91h50m17.830107937s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:23.402954338 (91h50m17.834034469s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Uploading piece... Aug 12 13:16:24.492397157 (91h50m18.923477288s) [upload=95700]: Next returned nil segment Aug 12 13:16:24.492415512 (91h50m18.923495633s) [upload=95700]: Waiting for error group managing segments... Aug 12 13:16:24.789106680 (91h50m19.220186811s) [noise=true , address=64.49.13.140:4511 , piece_id=QDGXD6MHAU23XS2AASW7SRWCW6WQH4JQGLLHDV7IRX5WKPKL4XCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:24.830054135 (91h50m19.261134266s) [noise=true , address=64.49.13.27:4960 , piece_id=UDSLD7MGL6SAIXE5ZTPG7UCEE45Q3X7FJNDVTPA6D3XW7ZXNHXWA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.344556882 (91h50m19.775637033s) [noise=true , address=104.36.82.39:4732 , piece_id=F4QXXVPXFB5TCKYWS5K6FI4YEXAPNTQ3SHFNBT6XN5HI52IV54JQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.363237674 (91h50m19.794317805s) [noise=true , address=104.36.82.35:4601 , piece_id=QF3YA2FZ4MFC3PDRJCTK2AR3XB3UJ675AXHT6WD6IQ6Q3XYWDBCA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.373711353 (91h50m19.804791484s) [noise=true , address=104.36.82.17:4350 , piece_id=5SFARWTXMHNYJQF7NTYG52KDLFTJHHZBLNWBL3UCJVK75DEUFOPA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.378110901 (91h50m19.809191032s) [noise=true , address=104.36.82.58:4277 , piece_id=EINLBTSAQWOXTSLESAJ2YRMXCFPLGZAALMWPB53O3J56W5EAFODA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.388394937 (91h50m19.819475058s) [noise=true , address=104.36.82.37:4687 , piece_id=STFF7N6CRI2IOLB7ELFM5V27H2NEQOCPCUCZG5VXQ4SYSX55665A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.391700030 (91h50m19.822780151s) [noise=true , address=104.36.82.38:4701 , piece_id=SPAUMA6YCX2CANCQM5VFVJDRA6NDC4JQRALBRRKG2Q4FR3WKV45A, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.444779637 (91h50m19.875859768s) [noise=true , address=104.36.82.59:4306 , piece_id=OAGPDVCMQIO4R65SXJJ5AUSYPXA5BODVXBR7K77MTAVKKPL7VAKA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.462579635 (91h50m19.893659766s) [noise=true , address=104.36.82.36:4619 , piece_id=YPMWKSVK6EJ4YAAVRZQ7LB4YAOKOZM27BGZIIIUL46DO7QJTHATQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.478081064 (91h50m19.909161195s) [noise=true , address=104.36.82.23:4466 , piece_id=4YOUM6PK3PVT3KLYA55UXMALJKPMQVMLDJLR5Y2L532446JHHQWQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.514473693 (91h50m19.945553824s) [noise=true , address=104.36.82.60:4372 , piece_id=YLPSUHY5AYULFE3FFRY7BE2ALWJI4WWCTEIERLUCBOPNPGB37OJA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.520069579 (91h50m19.9511497s) [noise=true , address=104.36.82.8:4982 , piece_id=BVJQ53RGV6Q2LD5WCA6T55AJLNMCVGRB4H5OBT4QYXR4NQ2QVHXQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526538206 (91h50m19.957618337s) [noise=true , address=104.36.82.9:4010 , piece_id=FDGWEH5NQK7X75U76BWNK4W4756D4OQOKT47FQIA65JNIHUAJJCQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: <nil> Aug 12 13:16:25.526570668 (91h50m19.957650799s) [seg_pos={0 0}, upload=95700]: Segment reached optimal threshold of 14 pieces. Aug 12 13:16:25.526782783 (91h50m19.957862935s) [noise=true , address=104.36.82.61:4395 , piece_id=TXCRHDSP3NTD5GBSVWVZNLBUBBYPMBVIETNHPLAT3Z2ZQZSON5IQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526816789 (91h50m19.95789692s) [noise=true , address=79.127.201.215:4345 , piece_id=DNPXXXCZJZ2L7BZSK6Z43UCNCR3PSFIYC4MKDJTTSTMLT6DRQY4Q, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u4jspTRDLXgx4VABvYM3XdZ3fnEfvC7rSiAzKKccUy4k3y4F8): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526886532 (91h50m19.957966673s) [noise=true , address=104.36.82.44:4886 , piece_id=XH5DLFKGEUEWR7UJOM3KOUMIZ74CJFB2FVQMZGYKKT2MBM7II6ZQ, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526917131 (91h50m19.957997272s) [noise=true , address=79.127.220.97:4368 , piece_id=SWQH5CV5KWL3JGJ32WRGF5GEB6NCMQ2EYEK5F3PU7O3XVTOSZANA, seg_pos={0 0}, upload=95700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QgJ1wJvVZg8sR6UVKZ2WWMEkdtoMnaBmmDprDXENYAH5ne9ef): protocol: expected piece hash; context canceled; EOF Aug 12 13:16:25.526935757 (91h50m19.958015888s) [seg_pos={0 0}, upload=95700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:16:25.527013395 (91h50m19.958093526s) [upload=95700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:16:25.527017593 (91h50m19.958097724s) [upload=95700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:16:25.838927109 (91h50m20.27000723s) [upload=95700]: Done uploading segments... Aug 12 13:16:25.838945494 (91h50m20.270025626s) [upload=95700]: Upload finished. err: <nil> Duration: 6.038931892s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.....X..................................................] duration: 8.691274143s FAIL (2025-08-12 13:15:58 UTC) orbiter warning: context deadline exceeded Duration: 8.691299471s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X.X......] duration: 2.010176747s FAIL (2025-08-12 13:15:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.010202969s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.......X.........X...] duration: 5.906793905s FAIL (2025-08-12 13:15:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 13:13:17.720585912 (91h47m12.151666043s) [upload=95648]: Starting upload Aug 12 13:13:17.720647500 (91h47m12.151727631s) [upload=95648]: Done starting upload Aug 12 13:13:17.720860737 (91h47m12.151940858s) [upload=95648]: Uploading segments... Aug 12 13:13:17.721505532 (91h47m12.152585663s) [upload=95648]: Got next segment. Inline: false Aug 12 13:13:17.721535569 (91h47m12.1526157s) [upload=95648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:13:17.721540318 (91h47m12.152620449s) [upload=95648]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:13:18.206426520 (91h47m12.637506671s) [seg_pos={0 0}, upload=95648]: Begin upload segment... Aug 12 13:13:18.206498427 (91h47m12.637578558s) [seg_pos={0 0}, upload=95648]: Done begin upload segment. Aug 12 13:13:18.206564614 (91h47m12.637644745s) [noise=true , address=104.36.82.46:4514 , piece_id=7XJNJTDXNNU6WZSXKRNNNVSJSZCGGX7SELNYAPAMYQTOBPA3K6MA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.206572950 (91h47m12.637653081s) [noise=true , address=79.127.201.215:4355 , piece_id=WCGMSZJLQEROU2L4KMY36T47XVQ4GAURFEEVMKAABBBHW5A3LT4A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207077224 (91h47m12.638157355s) [noise=true , address=104.36.82.61:4383 , piece_id=T7LBPLCP5NNOIQ2PJQOAQ37OVL6HZSP6UPLFOCCB3ITFDPI2SN5A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207130106 (91h47m12.638210227s) [noise=true , address=66.23.193.175:4554 , piece_id=PLZMNRKECIZYURSGDBHNA3QNREEF6XVRHEZMD3JENBHRUWKCOW2A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207428186 (91h47m12.638508317s) [noise=true , address=104.36.82.18:4395 , piece_id=JXPUGWSK35FSUFZCMOO2HOBFFSJ3PZYCYQMI7RFM764DK7ZZYYJQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207931829 (91h47m12.63901196s) [noise=true , address=104.36.82.36:4630 , piece_id=V3FZULDW3NWAZVPCO7XOOIZP2O6ZVGB3I3X2IYAJCJBZGTLYXQSA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208165517 (91h47m12.639245648s) [noise=true , address=64.49.13.140:4509 , piece_id=FMQ46KQDGN3MYI75QL52SJ3OZZZVEYKMDQ3BC5AXSH7DIMIEZC6A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208398272 (91h47m12.639478403s) [noise=true , address=104.36.82.5:4872 , piece_id=TQOMRWQOBESZ67DFENZ5REFSQJ3NL76YQ67SWWVLJT3LIV7L5K6Q, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208482032 (91h47m12.639562163s) [noise=true , address=104.36.82.62:4414 , piece_id=SVNSZARBEUW5GWUMRZKWXOLZASV2T4FO24HTVULNM3CHMXFMCFWA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208729506 (91h47m12.639809637s) [noise=true , address=104.36.82.60:4340 , piece_id=GUJQGU7K3IP3HGQPU4HENOKBJGMN7XXUQ46X2FI5Z47UUBJODQXQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.211187810 (91h47m12.642267941s) [noise=true , address=104.36.82.23:4463 , piece_id=FQ2UL7RYK4R5IMJXW7E4UYOU3XVJZ7TIAL3L2LN4DNJ3NH6K4QCA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.212063946 (91h47m12.643144077s) [noise=true , address=104.36.82.58:4267 , piece_id=GFDZW5JPUK7JW2PZVROBX3NZTDW7PCOLCVS2BTSDMNQBAMZOD2GA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.213286104 (91h47m12.644366235s) [noise=true , address=104.36.82.4:4829 , piece_id=M7AERIUO746K46W6RVIG6D3SYO42KNNO6W7AUVLKPYPGROTFJDKQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.214730368 (91h47m12.645810499s) [noise=true , address=104.36.82.17:4357 , piece_id=VYTJGJ4EAN6SA55WYMHPXA5FNXYDAWHIQTFBSWQX23VZ3YF45S2A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.215823739 (91h47m12.64690387s) [noise=true , address=104.36.82.59:4302 , piece_id=7PQJLFGLE6VC4QFUGZEJX27O6G7JXGTHWPXZJHGGBHEEQNP76VTA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.216335498 (91h47m12.64741563s) [noise=true , address=104.36.82.19:4405 , piece_id=CQSZNE66AHQEPIZFV3XFJGCSHIYPJOQ4CGYOGQEYMH7RYII73B2Q, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.216784387 (91h47m12.647864518s) [noise=true , address=64.49.13.169:4708 , piece_id=ORFFCDZZWFXYYQINVH6ZR3EDKJDUXLSYDOL3KAEGHWGTM3XYUJWQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.218082532 (91h47m12.649162663s) [noise=true , address=104.36.82.39:4745 , piece_id=74PNZN5XBA7FNU7GGPF57FCNMEVIARTU7HHZ636RWBZ6GRWODTWQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:19.367288725 (91h47m13.798368856s) [upload=95648]: Next returned nil segment Aug 12 13:13:19.367306458 (91h47m13.798386579s) [upload=95648]: Waiting for error group managing segments... Aug 12 13:13:19.684237121 (91h47m14.115317252s) [noise=true , address=64.49.13.140:4509 , piece_id=FMQ46KQDGN3MYI75QL52SJ3OZZZVEYKMDQ3BC5AXSH7DIMIEZC6A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:19.697492573 (91h47m14.128572704s) [noise=true , address=66.23.193.175:4554 , piece_id=PLZMNRKECIZYURSGDBHNA3QNREEF6XVRHEZMD3JENBHRUWKCOW2A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:19.715613984 (91h47m14.146694105s) [noise=true , address=64.49.13.169:4708 , piece_id=ORFFCDZZWFXYYQINVH6ZR3EDKJDUXLSYDOL3KAEGHWGTM3XYUJWQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.171125142 (91h47m14.602205273s) [noise=true , address=104.36.82.36:4630 , piece_id=V3FZULDW3NWAZVPCO7XOOIZP2O6ZVGB3I3X2IYAJCJBZGTLYXQSA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.192000363 (91h47m14.623080514s) [noise=true , address=104.36.82.46:4514 , piece_id=7XJNJTDXNNU6WZSXKRNNNVSJSZCGGX7SELNYAPAMYQTOBPA3K6MA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.200264485 (91h47m14.631344616s) [noise=true , address=104.36.82.62:4414 , piece_id=SVNSZARBEUW5GWUMRZKWXOLZASV2T4FO24HTVULNM3CHMXFMCFWA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.205494111 (91h47m14.636574242s) [noise=true , address=104.36.82.18:4395 , piece_id=JXPUGWSK35FSUFZCMOO2HOBFFSJ3PZYCYQMI7RFM764DK7ZZYYJQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.263317224 (91h47m14.694397355s) [noise=true , address=104.36.82.4:4829 , piece_id=M7AERIUO746K46W6RVIG6D3SYO42KNNO6W7AUVLKPYPGROTFJDKQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.308345375 (91h47m14.739425506s) [noise=true , address=104.36.82.58:4267 , piece_id=GFDZW5JPUK7JW2PZVROBX3NZTDW7PCOLCVS2BTSDMNQBAMZOD2GA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.313057762 (91h47m14.744137893s) [noise=true , address=104.36.82.23:4463 , piece_id=FQ2UL7RYK4R5IMJXW7E4UYOU3XVJZ7TIAL3L2LN4DNJ3NH6K4QCA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.324555280 (91h47m14.755635411s) [noise=true , address=104.36.82.60:4340 , piece_id=GUJQGU7K3IP3HGQPU4HENOKBJGMN7XXUQ46X2FI5Z47UUBJODQXQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.335446939 (91h47m14.76652707s) [noise=true , address=104.36.82.39:4745 , piece_id=74PNZN5XBA7FNU7GGPF57FCNMEVIARTU7HHZ636RWBZ6GRWODTWQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.346248966 (91h47m14.777329097s) [noise=true , address=104.36.82.17:4357 , piece_id=VYTJGJ4EAN6SA55WYMHPXA5FNXYDAWHIQTFBSWQX23VZ3YF45S2A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.359651630 (91h47m14.790731761s) [noise=true , address=104.36.82.19:4405 , piece_id=CQSZNE66AHQEPIZFV3XFJGCSHIYPJOQ4CGYOGQEYMH7RYII73B2Q, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.359674944 (91h47m14.790755075s) [seg_pos={0 0}, upload=95648]: Segment reached optimal threshold of 14 pieces. Aug 12 13:13:20.359804843 (91h47m14.790884974s) [noise=true , address=104.36.82.61:4383 , piece_id=T7LBPLCP5NNOIQ2PJQOAQ37OVL6HZSP6UPLFOCCB3ITFDPI2SN5A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N24q6Li2xavkE61KntNxDPwQzTVHaG4LxyEqFUT1hhGYNQ9mp): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359856541 (91h47m14.790936672s) [noise=true , address=104.36.82.5:4872 , piece_id=TQOMRWQOBESZ67DFENZ5REFSQJ3NL76YQ67SWWVLJT3LIV7L5K6Q, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359872843 (91h47m14.790952964s) [noise=true , address=79.127.201.215:4355 , piece_id=WCGMSZJLQEROU2L4KMY36T47XVQ4GAURFEEVMKAABBBHW5A3LT4A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359929151 (91h47m14.791009282s) [noise=true , address=104.36.82.59:4302 , piece_id=7PQJLFGLE6VC4QFUGZEJX27O6G7JXGTHWPXZJHGGBHEEQNP76VTA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tGpuYdPLiy4ncDjxrZbQfp7Bq79NVBHDmr4vjaL4qMpudrvgR): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359947376 (91h47m14.791027507s) [seg_pos={0 0}, upload=95648]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:13:20.360005387 (91h47m14.791085518s) [upload=95648]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:13:20.360009264 (91h47m14.791089555s) [upload=95648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:13:20.680141753 (91h47m15.111221884s) [upload=95648]: Done uploading segments... Aug 12 13:13:20.680160097 (91h47m15.111240228s) [upload=95648]: Upload finished. err: <nil> Duration: 5.906822691s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...X.....X.................................................] duration: 7.616077571s FAIL (2025-08-12 13:15:29 UTC) orbiter warning: context deadline exceeded Duration: 7.616092709s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X.X.....] duration: 2.118777202s FAIL (2025-08-12 13:15:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.118801739s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...X.....X................................................] duration: 8.259381481s FAIL (2025-08-12 13:14:55 UTC) orbiter warning: context deadline exceeded Duration: 8.259403064s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X.......X.........X..] duration: 5.855511883s FAIL (2025-08-12 13:14:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 13:13:17.720585912 (91h47m12.151666043s) [upload=95648]: Starting upload Aug 12 13:13:17.720647500 (91h47m12.151727631s) [upload=95648]: Done starting upload Aug 12 13:13:17.720860737 (91h47m12.151940858s) [upload=95648]: Uploading segments... Aug 12 13:13:17.721505532 (91h47m12.152585663s) [upload=95648]: Got next segment. Inline: false Aug 12 13:13:17.721535569 (91h47m12.1526157s) [upload=95648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:13:17.721540318 (91h47m12.152620449s) [upload=95648]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:13:18.206426520 (91h47m12.637506671s) [seg_pos={0 0}, upload=95648]: Begin upload segment... Aug 12 13:13:18.206498427 (91h47m12.637578558s) [seg_pos={0 0}, upload=95648]: Done begin upload segment. Aug 12 13:13:18.206564614 (91h47m12.637644745s) [noise=true , address=104.36.82.46:4514 , piece_id=7XJNJTDXNNU6WZSXKRNNNVSJSZCGGX7SELNYAPAMYQTOBPA3K6MA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.206572950 (91h47m12.637653081s) [noise=true , address=79.127.201.215:4355 , piece_id=WCGMSZJLQEROU2L4KMY36T47XVQ4GAURFEEVMKAABBBHW5A3LT4A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207077224 (91h47m12.638157355s) [noise=true , address=104.36.82.61:4383 , piece_id=T7LBPLCP5NNOIQ2PJQOAQ37OVL6HZSP6UPLFOCCB3ITFDPI2SN5A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207130106 (91h47m12.638210227s) [noise=true , address=66.23.193.175:4554 , piece_id=PLZMNRKECIZYURSGDBHNA3QNREEF6XVRHEZMD3JENBHRUWKCOW2A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207428186 (91h47m12.638508317s) [noise=true , address=104.36.82.18:4395 , piece_id=JXPUGWSK35FSUFZCMOO2HOBFFSJ3PZYCYQMI7RFM764DK7ZZYYJQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207931829 (91h47m12.63901196s) [noise=true , address=104.36.82.36:4630 , piece_id=V3FZULDW3NWAZVPCO7XOOIZP2O6ZVGB3I3X2IYAJCJBZGTLYXQSA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208165517 (91h47m12.639245648s) [noise=true , address=64.49.13.140:4509 , piece_id=FMQ46KQDGN3MYI75QL52SJ3OZZZVEYKMDQ3BC5AXSH7DIMIEZC6A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208398272 (91h47m12.639478403s) [noise=true , address=104.36.82.5:4872 , piece_id=TQOMRWQOBESZ67DFENZ5REFSQJ3NL76YQ67SWWVLJT3LIV7L5K6Q, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208482032 (91h47m12.639562163s) [noise=true , address=104.36.82.62:4414 , piece_id=SVNSZARBEUW5GWUMRZKWXOLZASV2T4FO24HTVULNM3CHMXFMCFWA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208729506 (91h47m12.639809637s) [noise=true , address=104.36.82.60:4340 , piece_id=GUJQGU7K3IP3HGQPU4HENOKBJGMN7XXUQ46X2FI5Z47UUBJODQXQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.211187810 (91h47m12.642267941s) [noise=true , address=104.36.82.23:4463 , piece_id=FQ2UL7RYK4R5IMJXW7E4UYOU3XVJZ7TIAL3L2LN4DNJ3NH6K4QCA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.212063946 (91h47m12.643144077s) [noise=true , address=104.36.82.58:4267 , piece_id=GFDZW5JPUK7JW2PZVROBX3NZTDW7PCOLCVS2BTSDMNQBAMZOD2GA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.213286104 (91h47m12.644366235s) [noise=true , address=104.36.82.4:4829 , piece_id=M7AERIUO746K46W6RVIG6D3SYO42KNNO6W7AUVLKPYPGROTFJDKQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.214730368 (91h47m12.645810499s) [noise=true , address=104.36.82.17:4357 , piece_id=VYTJGJ4EAN6SA55WYMHPXA5FNXYDAWHIQTFBSWQX23VZ3YF45S2A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.215823739 (91h47m12.64690387s) [noise=true , address=104.36.82.59:4302 , piece_id=7PQJLFGLE6VC4QFUGZEJX27O6G7JXGTHWPXZJHGGBHEEQNP76VTA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.216335498 (91h47m12.64741563s) [noise=true , address=104.36.82.19:4405 , piece_id=CQSZNE66AHQEPIZFV3XFJGCSHIYPJOQ4CGYOGQEYMH7RYII73B2Q, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.216784387 (91h47m12.647864518s) [noise=true , address=64.49.13.169:4708 , piece_id=ORFFCDZZWFXYYQINVH6ZR3EDKJDUXLSYDOL3KAEGHWGTM3XYUJWQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.218082532 (91h47m12.649162663s) [noise=true , address=104.36.82.39:4745 , piece_id=74PNZN5XBA7FNU7GGPF57FCNMEVIARTU7HHZ636RWBZ6GRWODTWQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:19.367288725 (91h47m13.798368856s) [upload=95648]: Next returned nil segment Aug 12 13:13:19.367306458 (91h47m13.798386579s) [upload=95648]: Waiting for error group managing segments... Aug 12 13:13:19.684237121 (91h47m14.115317252s) [noise=true , address=64.49.13.140:4509 , piece_id=FMQ46KQDGN3MYI75QL52SJ3OZZZVEYKMDQ3BC5AXSH7DIMIEZC6A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:19.697492573 (91h47m14.128572704s) [noise=true , address=66.23.193.175:4554 , piece_id=PLZMNRKECIZYURSGDBHNA3QNREEF6XVRHEZMD3JENBHRUWKCOW2A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:19.715613984 (91h47m14.146694105s) [noise=true , address=64.49.13.169:4708 , piece_id=ORFFCDZZWFXYYQINVH6ZR3EDKJDUXLSYDOL3KAEGHWGTM3XYUJWQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.171125142 (91h47m14.602205273s) [noise=true , address=104.36.82.36:4630 , piece_id=V3FZULDW3NWAZVPCO7XOOIZP2O6ZVGB3I3X2IYAJCJBZGTLYXQSA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.192000363 (91h47m14.623080514s) [noise=true , address=104.36.82.46:4514 , piece_id=7XJNJTDXNNU6WZSXKRNNNVSJSZCGGX7SELNYAPAMYQTOBPA3K6MA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.200264485 (91h47m14.631344616s) [noise=true , address=104.36.82.62:4414 , piece_id=SVNSZARBEUW5GWUMRZKWXOLZASV2T4FO24HTVULNM3CHMXFMCFWA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.205494111 (91h47m14.636574242s) [noise=true , address=104.36.82.18:4395 , piece_id=JXPUGWSK35FSUFZCMOO2HOBFFSJ3PZYCYQMI7RFM764DK7ZZYYJQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.263317224 (91h47m14.694397355s) [noise=true , address=104.36.82.4:4829 , piece_id=M7AERIUO746K46W6RVIG6D3SYO42KNNO6W7AUVLKPYPGROTFJDKQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.308345375 (91h47m14.739425506s) [noise=true , address=104.36.82.58:4267 , piece_id=GFDZW5JPUK7JW2PZVROBX3NZTDW7PCOLCVS2BTSDMNQBAMZOD2GA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.313057762 (91h47m14.744137893s) [noise=true , address=104.36.82.23:4463 , piece_id=FQ2UL7RYK4R5IMJXW7E4UYOU3XVJZ7TIAL3L2LN4DNJ3NH6K4QCA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.324555280 (91h47m14.755635411s) [noise=true , address=104.36.82.60:4340 , piece_id=GUJQGU7K3IP3HGQPU4HENOKBJGMN7XXUQ46X2FI5Z47UUBJODQXQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.335446939 (91h47m14.76652707s) [noise=true , address=104.36.82.39:4745 , piece_id=74PNZN5XBA7FNU7GGPF57FCNMEVIARTU7HHZ636RWBZ6GRWODTWQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.346248966 (91h47m14.777329097s) [noise=true , address=104.36.82.17:4357 , piece_id=VYTJGJ4EAN6SA55WYMHPXA5FNXYDAWHIQTFBSWQX23VZ3YF45S2A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.359651630 (91h47m14.790731761s) [noise=true , address=104.36.82.19:4405 , piece_id=CQSZNE66AHQEPIZFV3XFJGCSHIYPJOQ4CGYOGQEYMH7RYII73B2Q, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.359674944 (91h47m14.790755075s) [seg_pos={0 0}, upload=95648]: Segment reached optimal threshold of 14 pieces. Aug 12 13:13:20.359804843 (91h47m14.790884974s) [noise=true , address=104.36.82.61:4383 , piece_id=T7LBPLCP5NNOIQ2PJQOAQ37OVL6HZSP6UPLFOCCB3ITFDPI2SN5A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N24q6Li2xavkE61KntNxDPwQzTVHaG4LxyEqFUT1hhGYNQ9mp): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359856541 (91h47m14.790936672s) [noise=true , address=104.36.82.5:4872 , piece_id=TQOMRWQOBESZ67DFENZ5REFSQJ3NL76YQ67SWWVLJT3LIV7L5K6Q, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359872843 (91h47m14.790952964s) [noise=true , address=79.127.201.215:4355 , piece_id=WCGMSZJLQEROU2L4KMY36T47XVQ4GAURFEEVMKAABBBHW5A3LT4A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359929151 (91h47m14.791009282s) [noise=true , address=104.36.82.59:4302 , piece_id=7PQJLFGLE6VC4QFUGZEJX27O6G7JXGTHWPXZJHGGBHEEQNP76VTA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tGpuYdPLiy4ncDjxrZbQfp7Bq79NVBHDmr4vjaL4qMpudrvgR): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359947376 (91h47m14.791027507s) [seg_pos={0 0}, upload=95648]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:13:20.360005387 (91h47m14.791085518s) [upload=95648]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:13:20.360009264 (91h47m14.791089555s) [upload=95648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:13:20.680141753 (91h47m15.111221884s) [upload=95648]: Done uploading segments... Aug 12 13:13:20.680160097 (91h47m15.111240228s) [upload=95648]: Upload finished. err: <nil> Duration: 5.855547861s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X.X....] duration: 1.907061065s FAIL (2025-08-12 13:14:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 1.907088838s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...X.....X...............................................] duration: 7.876607041s FAIL (2025-08-12 13:14:18 UTC) orbiter warning: context deadline exceeded Duration: 7.876628151s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................................X.......X.........X.] duration: 5.655648268s FAIL (2025-08-12 13:14:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 13:13:17.720585912 (91h47m12.151666043s) [upload=95648]: Starting upload Aug 12 13:13:17.720647500 (91h47m12.151727631s) [upload=95648]: Done starting upload Aug 12 13:13:17.720860737 (91h47m12.151940858s) [upload=95648]: Uploading segments... Aug 12 13:13:17.721505532 (91h47m12.152585663s) [upload=95648]: Got next segment. Inline: false Aug 12 13:13:17.721535569 (91h47m12.1526157s) [upload=95648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:13:17.721540318 (91h47m12.152620449s) [upload=95648]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 13:13:18.206426520 (91h47m12.637506671s) [seg_pos={0 0}, upload=95648]: Begin upload segment... Aug 12 13:13:18.206498427 (91h47m12.637578558s) [seg_pos={0 0}, upload=95648]: Done begin upload segment. Aug 12 13:13:18.206564614 (91h47m12.637644745s) [noise=true , address=104.36.82.46:4514 , piece_id=7XJNJTDXNNU6WZSXKRNNNVSJSZCGGX7SELNYAPAMYQTOBPA3K6MA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.206572950 (91h47m12.637653081s) [noise=true , address=79.127.201.215:4355 , piece_id=WCGMSZJLQEROU2L4KMY36T47XVQ4GAURFEEVMKAABBBHW5A3LT4A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207077224 (91h47m12.638157355s) [noise=true , address=104.36.82.61:4383 , piece_id=T7LBPLCP5NNOIQ2PJQOAQ37OVL6HZSP6UPLFOCCB3ITFDPI2SN5A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207130106 (91h47m12.638210227s) [noise=true , address=66.23.193.175:4554 , piece_id=PLZMNRKECIZYURSGDBHNA3QNREEF6XVRHEZMD3JENBHRUWKCOW2A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207428186 (91h47m12.638508317s) [noise=true , address=104.36.82.18:4395 , piece_id=JXPUGWSK35FSUFZCMOO2HOBFFSJ3PZYCYQMI7RFM764DK7ZZYYJQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.207931829 (91h47m12.63901196s) [noise=true , address=104.36.82.36:4630 , piece_id=V3FZULDW3NWAZVPCO7XOOIZP2O6ZVGB3I3X2IYAJCJBZGTLYXQSA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208165517 (91h47m12.639245648s) [noise=true , address=64.49.13.140:4509 , piece_id=FMQ46KQDGN3MYI75QL52SJ3OZZZVEYKMDQ3BC5AXSH7DIMIEZC6A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208398272 (91h47m12.639478403s) [noise=true , address=104.36.82.5:4872 , piece_id=TQOMRWQOBESZ67DFENZ5REFSQJ3NL76YQ67SWWVLJT3LIV7L5K6Q, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208482032 (91h47m12.639562163s) [noise=true , address=104.36.82.62:4414 , piece_id=SVNSZARBEUW5GWUMRZKWXOLZASV2T4FO24HTVULNM3CHMXFMCFWA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.208729506 (91h47m12.639809637s) [noise=true , address=104.36.82.60:4340 , piece_id=GUJQGU7K3IP3HGQPU4HENOKBJGMN7XXUQ46X2FI5Z47UUBJODQXQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.211187810 (91h47m12.642267941s) [noise=true , address=104.36.82.23:4463 , piece_id=FQ2UL7RYK4R5IMJXW7E4UYOU3XVJZ7TIAL3L2LN4DNJ3NH6K4QCA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.212063946 (91h47m12.643144077s) [noise=true , address=104.36.82.58:4267 , piece_id=GFDZW5JPUK7JW2PZVROBX3NZTDW7PCOLCVS2BTSDMNQBAMZOD2GA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.213286104 (91h47m12.644366235s) [noise=true , address=104.36.82.4:4829 , piece_id=M7AERIUO746K46W6RVIG6D3SYO42KNNO6W7AUVLKPYPGROTFJDKQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.214730368 (91h47m12.645810499s) [noise=true , address=104.36.82.17:4357 , piece_id=VYTJGJ4EAN6SA55WYMHPXA5FNXYDAWHIQTFBSWQX23VZ3YF45S2A, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.215823739 (91h47m12.64690387s) [noise=true , address=104.36.82.59:4302 , piece_id=7PQJLFGLE6VC4QFUGZEJX27O6G7JXGTHWPXZJHGGBHEEQNP76VTA, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.216335498 (91h47m12.64741563s) [noise=true , address=104.36.82.19:4405 , piece_id=CQSZNE66AHQEPIZFV3XFJGCSHIYPJOQ4CGYOGQEYMH7RYII73B2Q, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.216784387 (91h47m12.647864518s) [noise=true , address=64.49.13.169:4708 , piece_id=ORFFCDZZWFXYYQINVH6ZR3EDKJDUXLSYDOL3KAEGHWGTM3XYUJWQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:18.218082532 (91h47m12.649162663s) [noise=true , address=104.36.82.39:4745 , piece_id=74PNZN5XBA7FNU7GGPF57FCNMEVIARTU7HHZ636RWBZ6GRWODTWQ, seg_pos={0 0}, upload=95648]: Uploading piece... Aug 12 13:13:19.367288725 (91h47m13.798368856s) [upload=95648]: Next returned nil segment Aug 12 13:13:19.367306458 (91h47m13.798386579s) [upload=95648]: Waiting for error group managing segments... Aug 12 13:13:19.684237121 (91h47m14.115317252s) [noise=true , address=64.49.13.140:4509 , piece_id=FMQ46KQDGN3MYI75QL52SJ3OZZZVEYKMDQ3BC5AXSH7DIMIEZC6A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:19.697492573 (91h47m14.128572704s) [noise=true , address=66.23.193.175:4554 , piece_id=PLZMNRKECIZYURSGDBHNA3QNREEF6XVRHEZMD3JENBHRUWKCOW2A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:19.715613984 (91h47m14.146694105s) [noise=true , address=64.49.13.169:4708 , piece_id=ORFFCDZZWFXYYQINVH6ZR3EDKJDUXLSYDOL3KAEGHWGTM3XYUJWQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.171125142 (91h47m14.602205273s) [noise=true , address=104.36.82.36:4630 , piece_id=V3FZULDW3NWAZVPCO7XOOIZP2O6ZVGB3I3X2IYAJCJBZGTLYXQSA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.192000363 (91h47m14.623080514s) [noise=true , address=104.36.82.46:4514 , piece_id=7XJNJTDXNNU6WZSXKRNNNVSJSZCGGX7SELNYAPAMYQTOBPA3K6MA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.200264485 (91h47m14.631344616s) [noise=true , address=104.36.82.62:4414 , piece_id=SVNSZARBEUW5GWUMRZKWXOLZASV2T4FO24HTVULNM3CHMXFMCFWA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.205494111 (91h47m14.636574242s) [noise=true , address=104.36.82.18:4395 , piece_id=JXPUGWSK35FSUFZCMOO2HOBFFSJ3PZYCYQMI7RFM764DK7ZZYYJQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.263317224 (91h47m14.694397355s) [noise=true , address=104.36.82.4:4829 , piece_id=M7AERIUO746K46W6RVIG6D3SYO42KNNO6W7AUVLKPYPGROTFJDKQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.308345375 (91h47m14.739425506s) [noise=true , address=104.36.82.58:4267 , piece_id=GFDZW5JPUK7JW2PZVROBX3NZTDW7PCOLCVS2BTSDMNQBAMZOD2GA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.313057762 (91h47m14.744137893s) [noise=true , address=104.36.82.23:4463 , piece_id=FQ2UL7RYK4R5IMJXW7E4UYOU3XVJZ7TIAL3L2LN4DNJ3NH6K4QCA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.324555280 (91h47m14.755635411s) [noise=true , address=104.36.82.60:4340 , piece_id=GUJQGU7K3IP3HGQPU4HENOKBJGMN7XXUQ46X2FI5Z47UUBJODQXQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.335446939 (91h47m14.76652707s) [noise=true , address=104.36.82.39:4745 , piece_id=74PNZN5XBA7FNU7GGPF57FCNMEVIARTU7HHZ636RWBZ6GRWODTWQ, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.346248966 (91h47m14.777329097s) [noise=true , address=104.36.82.17:4357 , piece_id=VYTJGJ4EAN6SA55WYMHPXA5FNXYDAWHIQTFBSWQX23VZ3YF45S2A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.359651630 (91h47m14.790731761s) [noise=true , address=104.36.82.19:4405 , piece_id=CQSZNE66AHQEPIZFV3XFJGCSHIYPJOQ4CGYOGQEYMH7RYII73B2Q, seg_pos={0 0}, upload=95648]: Done uploading piece. err: <nil> Aug 12 13:13:20.359674944 (91h47m14.790755075s) [seg_pos={0 0}, upload=95648]: Segment reached optimal threshold of 14 pieces. Aug 12 13:13:20.359804843 (91h47m14.790884974s) [noise=true , address=104.36.82.61:4383 , piece_id=T7LBPLCP5NNOIQ2PJQOAQ37OVL6HZSP6UPLFOCCB3ITFDPI2SN5A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N24q6Li2xavkE61KntNxDPwQzTVHaG4LxyEqFUT1hhGYNQ9mp): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359856541 (91h47m14.790936672s) [noise=true , address=104.36.82.5:4872 , piece_id=TQOMRWQOBESZ67DFENZ5REFSQJ3NL76YQ67SWWVLJT3LIV7L5K6Q, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359872843 (91h47m14.790952964s) [noise=true , address=79.127.201.215:4355 , piece_id=WCGMSZJLQEROU2L4KMY36T47XVQ4GAURFEEVMKAABBBHW5A3LT4A, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359929151 (91h47m14.791009282s) [noise=true , address=104.36.82.59:4302 , piece_id=7PQJLFGLE6VC4QFUGZEJX27O6G7JXGTHWPXZJHGGBHEEQNP76VTA, seg_pos={0 0}, upload=95648]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tGpuYdPLiy4ncDjxrZbQfp7Bq79NVBHDmr4vjaL4qMpudrvgR): protocol: expected piece hash; context canceled; EOF Aug 12 13:13:20.359947376 (91h47m14.791027507s) [seg_pos={0 0}, upload=95648]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 13:13:20.360005387 (91h47m14.791085518s) [upload=95648]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 13:13:20.360009264 (91h47m14.791089555s) [upload=95648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:13:20.680141753 (91h47m15.111221884s) [upload=95648]: Done uploading segments... Aug 12 13:13:20.680160097 (91h47m15.111240228s) [upload=95648]: Upload finished. err: <nil> Duration: 5.655671382s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X.X...] duration: 2.067017983s FAIL (2025-08-12 13:13:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0afea1286d500709c6eacbc885f14f7096b14f8840e69c9d8166cb8e2debf29 != before 71329f9a8409421df671902efc6f0a67ff5f48d20c74cf8dedf1607d6cf675b6 ======LOGS====== Aug 12 13:11:35.965632559 (91h45m30.39671269s) [upload=95618]: Starting upload Aug 12 13:11:35.965698475 (91h45m30.396778606s) [upload=95618]: Done starting upload Aug 12 13:11:35.965761024 (91h45m30.396841155s) [upload=95618]: Uploading segments... Aug 12 13:11:35.965844103 (91h45m30.396924234s) [upload=95618]: Got next segment. Inline: true Aug 12 13:11:35.965854404 (91h45m30.396934535s) [upload=95618]: Waiting for error group managing segments... Aug 12 13:11:35.965890853 (91h45m30.396970974s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 13:11:35.965895442 (91h45m30.396975573s) [upload=95618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 13:11:35.965898257 (91h45m30.396978388s) [upload=95618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 13:11:36.243042387 (91h45m30.674122508s) [upload=95618]: Done uploading segments... Aug 12 13:11:36.243057095 (91h45m30.674137226s) [upload=95618]: Upload finished. err: <nil> Duration:* 2.06704264s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...X.....X..............................................] duration: 7.531599681s FAIL (2025-08-12 13:13:44 UTC) orbiter warning: context deadline exceeded Duration: 7.531622704s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)