Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 390100 reports (Page 6146 of 7802)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [......X.................X...X.......X.X..X..................]
duration:
6.263726201s
FAIL (2025-08-06 16:31:34 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 6.263756208s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
6.256421313s
FAIL (2025-08-06 16:31:24 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 6.2564462s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
5.963664154s
FAIL (2025-08-06 16:31:08 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.963690845s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [.......X.................X...X.......X.X..X.................]
duration:
5.77304775s
FAIL (2025-08-06 16:30:51 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.773073881s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
5.918575796s
FAIL (2025-08-06 16:30:07 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.918604119s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [........X.................X...X.......X.X..X................]
duration:
5.678224702s
FAIL (2025-08-06 16:30:05 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.678248017s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
5.849853447s
FAIL (2025-08-06 16:29:37 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.849878676s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [.........X.................X...X.......X.X..X...............]
duration:
6.055668055s
FAIL (2025-08-06 16:29:19 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 6.05568674s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
5.725655672s
FAIL (2025-08-06 16:28:58 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.725679767s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [..........X.................X...X.......X.X..X..............]
duration:
5.67525036s
FAIL (2025-08-06 16:28:21 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.67527121s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
6.180661821s
FAIL (2025-08-06 16:28:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 6.180695426s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
5.931469854s
FAIL (2025-08-06 16:27:19 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.931499602s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [...........X.................X...X.......X.X..X.............]
duration:
5.636044752s
FAIL (2025-08-06 16:27:10 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.636067827s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
6.204854994s
FAIL (2025-08-06 16:26:55 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 6.204884751s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [............X.................X...X.......X.X..X............]
duration:
5.871073408s
FAIL (2025-08-06 16:26:47 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.871092844s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
6.275004657s
FAIL (2025-08-06 16:26:20 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 6.275045384s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [.............X.................X...X.......X.X..X...........]
duration:
5.951893252s
FAIL (2025-08-06 16:25:40 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.951921297s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
5.871939806s
FAIL (2025-08-06 16:25:33 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.871963251s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
5.890986838s
FAIL (2025-08-06 16:24:48 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.891010134s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
5.857751384s
FAIL (2025-08-06 16:24:27 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.857776672s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [..............X.................X...X.......X.X..X..........]
duration:
5.749542544s
FAIL (2025-08-06 16:24:25 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.749570268s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
5.802120483s
FAIL (2025-08-06 16:23:55 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.80214501s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [...............X.................X...X.......X.X..X.........]
duration:
5.963851521s
FAIL (2025-08-06 16:23:44 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.96387719s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
5.75788223s
FAIL (2025-08-06 16:23:35 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.757906568s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
7 out of 60 is failed (threshold=3) [X...............X.................X...X.......X.X..X........]
duration:
5.891901851s
FAIL (2025-08-06 16:23:11 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.891926367s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
6.004812049s
FAIL (2025-08-06 16:23:03 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 6.004841015s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
5.777924115s
FAIL (2025-08-06 16:22:33 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.777949454s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
5.872046059s
FAIL (2025-08-06 16:22:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.872072871s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
7 out of 60 is failed (threshold=3) [.X...............X.................X...X.......X.X..X.......]
duration:
5.706284898s
FAIL (2025-08-06 16:22:06 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.706310158s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
7 out of 60 is failed (threshold=3) [..X...............X.................X...X.......X.X..X......]
duration:
5.969979939s
FAIL (2025-08-06 16:21:35 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.970004926s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
6.132055677s
FAIL (2025-08-06 16:21:34 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 6.132076819s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
6.266213639s
FAIL (2025-08-06 16:20:59 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 6.266237546s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
7 out of 60 is failed (threshold=3) [...X...............X.................X...X.......X.X..X.....]
duration:
5.856039464s
FAIL (2025-08-06 16:20:20 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.856065675s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
5.734855544s
FAIL (2025-08-06 16:19:46 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.734880232s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
7 out of 60 is failed (threshold=3) [....X...............X.................X...X.......X.X..X....]
duration:
5.896649072s
FAIL (2025-08-06 16:19:16 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.89667413s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
5.740263821s
FAIL (2025-08-06 16:18:54 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.740287277s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
6.053105171s
FAIL (2025-08-06 16:18:30 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 6.053128285s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
7 out of 60 is failed (threshold=3) [.....X...............X.................X...X.......X.X..X...]
duration:
5.823358698s
FAIL (2025-08-06 16:18:05 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.823383035s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
5.876034751s
FAIL (2025-08-06 16:17:54 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 5.876053977s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
20.489139298s
FAIL (2025-08-06 16:17:29 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 20.489165128s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
7 out of 60 is failed (threshold=3) [......X...............X.................X...X.......X.X..X..]
duration:
5.858844401s
FAIL (2025-08-06 16:17:22 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.858870752s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
7 out of 60 is failed (threshold=3) [.......X...............X.................X...X.......X.X..X.]
duration:
5.871503723s
FAIL (2025-08-06 16:17:02 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.871527628s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001739281s
FAIL (2025-08-06 16:16:29 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
cted piece hash; context canceled; EOF
Aug  6 16:15:07.596899502 (2h6m15.535315351s) [noise=true , address=104.36.82.12:4151    , piece_id=B4D7VTLBQBRSPKA7N42KZTE7V5TSS754ZV7EF75JJEFDOW55O4CQ, seg_pos={0 0}, upload=2001]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF
Aug  6 16:15:07.596915132 (2h6m15.535330981s) [seg_pos={0 0}, upload=2001]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:15:07.596991619 (2h6m15.535407468s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:15:07.596995857 (2h6m15.535411706s) [upload=2001]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:15:07.887184563 (2h6m15.825600412s) [upload=2001]: Done uploading segments...
Aug  6 16:15:07.887203770 (2h6m15.825619609s) [upload=2001]: Upload finished. err: <nil>
Aug  6 16:16:00.579639900 (2h7m8.518055749s) [upload=2016]: Starting upload
Aug  6 16:16:00.579694645 (2h7m8.518110494s) [upload=2016]: Done starting upload
Aug  6 16:16:00.579789666 (2h7m8.518205515s) [upload=2016]: Uploading segments...
Aug  6 16:16:00.579861003 (2h7m8.518276852s) [upload=2016]: Got next segment. Inline: false
Aug  6 16:16:00.579885871 (2h7m8.51830172s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug  6 16:16:00.579889858 (2h7m8.518305707s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug  6 16:16:00.820626959 (2h7m8.759042808s) [seg_pos={0 0}, upload=2016]: Begin upload segment...
Aug  6 16:16:00.820694769 (2h7m8.759110629s) [seg_pos={0 0}, upload=2016]: Done begin upload segment.
Aug  6 16:16:00.820738192 (2h7m8.759154041s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.820754293 (2h7m8.759170142s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821224302 (2h7m8.759640151s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821272084 (2h7m8.759687983s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.821617053 (2h7m8.760032903s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822107232 (2h7m8.760523091s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822131258 (2h7m8.760547107s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822500845 (2h7m8.760916694s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822543386 (2h7m8.760959235s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.822973009 (2h7m8.761388858s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823204822 (2h7m8.761620661s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823426235 (2h7m8.761842084s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823693006 (2h7m8.762108855s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.823992970 (2h7m8.762408819s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824130774 (2h7m8.762546623s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:00.824422621 (2h7m8.76283848s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Uploading piece...
Aug  6 16:16:02.555639143 (2h7m10.494054992s) [upload=2016]: Next returned nil segment
Aug  6 16:16:02.555659893 (2h7m10.494075752s) [upload=2016]: Waiting for error group managing segments...
Aug  6 16:16:02.837308740 (2h7m10.775724589s) [noise=true , address=45.91.116.5:4298     , piece_id=WBH7PQI45FU2XVIE2BRQPLVCV32MME34DV24ZAQB625VGY3PDA3Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.882019636 (2h7m10.820435485s) [noise=true , address=77.90.31.19:4841     , piece_id=KQSHAVBEGRVWT7LHBNORUM2ZQBC6F5IQWQ3XCQ25UJUYNJW5QUEA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.917400741 (2h7m10.85581659s) [noise=true , address=45.91.116.8:4048     , piece_id=NAPMUXSXDIIWECP3QVA5CXSL7V4I2PRKEHD3422K6VCXI5YNIFMQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.947806114 (2h7m10.886221963s) [noise=true , address=45.91.116.12:4225    , piece_id=6ZDHNKA2TLCCVZ436KUG6MCWJN3BUWW34MR56AOWJI22XXVNBFQA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.964255246 (2h7m10.902671095s) [noise=true , address=104.36.82.4:4801     , piece_id=S5UFPPCIMSCXIAIF6PJ2P5L4KAA5IVO5RG4F33W3CAQA6KHVFR2Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972488429 (2h7m10.910904278s) [noise=true , address=104.36.82.9:4006     , piece_id=4BRGRC53TEW6FJRKN3U2ZE2JCNXJSP3EP7SPY22QNZUEX2WJQLPQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:02.972812389 (2h7m10.911228238s) [noise=true , address=45.91.116.14:4190    , piece_id=7OJP24AR7HKAPBY6ND33N4WZV2BWRVV4YIK6D6LCZ3LCR2QNZILQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.001575382 (2h7m10.939991231s) [noise=true , address=77.90.31.10:4520     , piece_id=XE4HQEP55KJKD7Z4AWBVG3ZY54ZL2SKUNASTUUZP6BAINDU6Z4PQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.028168973 (2h7m10.966584822s) [noise=true , address=104.36.82.4:4803     , piece_id=HDDNPPVS2TYDWNEKJO4UCI4KQB7VSBN55U4GRYDM6MLG2KC3QPCA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.036656182 (2h7m10.975072031s) [noise=true , address=45.91.116.7:4009     , piece_id=F3GL2GSZRKR3XXDK2PNCGYXIHRND6HAXGRMNGTKJVHUPO4JSIXBA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.044792840 (2h7m10.983208689s) [noise=true , address=104.36.82.12:4149    , piece_id=OKWNJAG5TT6LTJ7PQDMW26WBTBHKL6UVY467QMO5AFVL2TQPCFTQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.045187775 (2h7m10.983603634s) [noise=true , address=77.90.31.18:4805     , piece_id=75BZU4YOCX3VFJD4U3U3L2LKTRVULEQWNBI65OAO6PVLSGZXVIVA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118252640 (2h7m11.056668479s) [noise=true , address=104.36.82.5:4839     , piece_id=U3MUBVB72IHYEZ5LMTYKAQYEIUZSF7FO26SODUBKNU435AN3HKIQ, seg_pos={0 0}, upload=2016]: Done uploading piece. err: <nil>
Aug  6 16:16:03.118270995 (2h7m11.056686844s) [seg_pos={0 0}, upload=2016]: Segment reached optimal threshold of 13 pieces.
Aug  6 16:16:03.118456620 (2h7m11.056872469s) [noise=true , address=77.90.31.11:4553     , piece_id=BFHSMJA7CPQ23FR7G2ZFN3FQ44KOIIR6JCD23THQVKBRQLTHPGJA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119323248 (2h7m11.057739097s) [noise=true , address=104.36.82.9:4007     , piece_id=YNCBPP64M2CDK4R4K45T43CXVDAGU2AMVCDXTW4JGC4FEWF6PLHA, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF
Aug  6 16:16:03.119734826 (2h7m11.058150675s) [noise=true , address=77.90.31.16:4733     , piece_id=6XP6XWV76DNPF5SWPPER7VFJMAAN5JT5NOVKBUKPNPJ5MXJSO74Q, seg_pos={0 0}, upload=2016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf): protocol: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33610->77.90.31.16:4733: use of closed network connection
Aug  6 16:16:03.119748902 (2h7m11.058164751s) [seg_pos={0 0}, upload=2016]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug  6 16:16:03.119818285 (2h7m11.058234134s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug  6 16:16:03.119823415 (2h7m11.058239264s) [upload=2016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug  6 16:16:03.416354947 (2h7m11.354770796s) [upload=2016]: Done uploading segments...
Aug  6 16:16:03.416374936 (2h7m11.354790785s) [upload=2016]: Upload finished. err: <nil>
Duration: 30.001762165s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
7 out of 60 is failed (threshold=3) [........X...............X.................X...X.......X.X..X]
duration:
5.796944101s
FAIL (2025-08-06 16:16:07 UTC)
orbiter warning: operation: sync2.Copy
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f395fdacab1f0a6d50e907eec6c6ff6d88983e2814221f573d5e725127393ad5 != before 1418f663260d7e5de0789785a1091a10fd5b67dd226a9347cd34a95fcec3c3e9
Duration: 5.796972424s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [.........X...............X.................X...X.......X.X..]
duration:
5.779133792s
FAIL (2025-08-06 16:15:37 UTC)
orbiter warning: operation: ListObjects
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.779154142s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [..........X...............X.................X...X.......X.X.]
duration:
5.642403778s
FAIL (2025-08-06 16:14:46 UTC)
orbiter warning: operation: ListObjects
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.642427503s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [...........X...............X.................X...X.......X.X]
duration:
4.053017224s
FAIL (2025-08-06 16:13:43 UTC)
orbiter warning: operation: ListObjects
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 4.053038704s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [............X...............X.................X...X.......X.]
duration:
6.073411043s
FAIL (2025-08-06 16:13:13 UTC)
orbiter warning: operation: ListObjects
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 6.073444206s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [.............X...............X.................X...X.......X]
duration:
3.987496863s
FAIL (2025-08-06 16:12:11 UTC)
orbiter warning: operation: ListObjects
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 3.987524878s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [..............X...............X.................X...X.......]
duration:
5.695509163s
FAIL (2025-08-06 16:11:53 UTC)
orbiter warning: operation: sync2.Copy
uplink: too many requests
Duration: 5.695538359s core uplink us-select-1 us1-placement-20