Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.670379946s FAIL (2025-07-02 17:00:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== l 2 16:53:34.097254581 (223h43m8.867895916s) [noise=true , address=77.90.31.13:4628 , piece_id=XMRK6IRQB7JXEMN7CXJOJHXUWZTOPOULFNYXOQIPLJHZD3NUBBVQ, seg_pos={0 0}, upload=178933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Jul 2 16:53:34.097307081 (223h43m8.867948416s) [seg_pos={0 0}, upload=178933]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:53:34.097386623 (223h43m8.868027959s) [upload=178933]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:53:34.097392004 (223h43m8.868033329s) [upload=178933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:53:34.419688729 (223h43m9.190330064s) [upload=178933]: Done uploading segments... Jul 2 16:53:34.419709358 (223h43m9.190350703s) [upload=178933]: Upload finished. err: <nil> Jul 2 16:54:05.262461990 (223h43m40.033103325s) [upload=178943]: Starting upload Jul 2 16:54:05.262511685 (223h43m40.03315302s) [upload=178943]: Done starting upload Jul 2 16:54:05.262549186 (223h43m40.033190521s) [upload=178943]: Uploading segments... Jul 2 16:54:05.262676380 (223h43m40.033317715s) [upload=178943]: Got next segment. Inline: false Jul 2 16:54:05.262704774 (223h43m40.033346109s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:54:05.262708992 (223h43m40.033350327s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:54:05.512996024 (223h43m40.283637359s) [seg_pos={0 0}, upload=178943]: Begin upload segment... Jul 2 16:54:05.513035330 (223h43m40.283676665s) [seg_pos={0 0}, upload=178943]: Done begin upload segment. Jul 2 16:54:05.513051209 (223h43m40.283692544s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513061560 (223h43m40.283702895s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513394557 (223h43m40.284035892s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513703728 (223h43m40.284345053s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513773561 (223h43m40.284414896s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513982151 (223h43m40.284623486s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514021205 (223h43m40.28466254s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514233051 (223h43m40.284874386s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514236677 (223h43m40.284878002s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514851123 (223h43m40.285492458s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514883755 (223h43m40.28552509s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515120498 (223h43m40.285761823s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515370256 (223h43m40.286011591s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516025430 (223h43m40.286666765s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516534103 (223h43m40.287175438s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.517178174 (223h43m40.28781951s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:07.112928981 (223h43m41.883570316s) [upload=178943]: Next returned nil segment Jul 2 16:54:07.112946585 (223h43m41.88358792s) [upload=178943]: Waiting for error group managing segments... Jul 2 16:54:07.457575995 (223h43m42.22821733s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.458802101 (223h43m42.229443436s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.466429934 (223h43m42.237071269s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.474520202 (223h43m42.245161527s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.488959054 (223h43m42.259600389s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.491690220 (223h43m42.262331555s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.503267458 (223h43m42.273908793s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.514613936 (223h43m42.285255271s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.531889065 (223h43m42.3025304s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.582720442 (223h43m42.353361767s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.584813677 (223h43m42.355455012s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.607187571 (223h43m42.377828896s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608616895 (223h43m42.37925824s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608631964 (223h43m42.379273299s) [seg_pos={0 0}, upload=178943]: Segment reached optimal threshold of 13 pieces. Jul 2 16:54:07.608785709 (223h43m42.379427034s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608881211 (223h43m42.379522546s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608968247 (223h43m42.379609572s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.609004217 (223h43m42.379645552s) [seg_pos={0 0}, upload=178943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:54:07.609097285 (223h43m42.37973862s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:54:07.609104839 (223h43m42.379746174s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:54:07.995690087 (223h43m42.766331422s) [upload=178943]: Done uploading segments... Jul 2 16:54:07.995712629 (223h43m42.766353974s) [upload=178943]: Upload finished. err: <nil> Duration: 5.670406095s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.670577233s FAIL (2025-07-02 16:59:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== l 2 16:53:34.097254581 (223h43m8.867895916s) [noise=true , address=77.90.31.13:4628 , piece_id=XMRK6IRQB7JXEMN7CXJOJHXUWZTOPOULFNYXOQIPLJHZD3NUBBVQ, seg_pos={0 0}, upload=178933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Jul 2 16:53:34.097307081 (223h43m8.867948416s) [seg_pos={0 0}, upload=178933]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:53:34.097386623 (223h43m8.868027959s) [upload=178933]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:53:34.097392004 (223h43m8.868033329s) [upload=178933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:53:34.419688729 (223h43m9.190330064s) [upload=178933]: Done uploading segments... Jul 2 16:53:34.419709358 (223h43m9.190350703s) [upload=178933]: Upload finished. err: <nil> Jul 2 16:54:05.262461990 (223h43m40.033103325s) [upload=178943]: Starting upload Jul 2 16:54:05.262511685 (223h43m40.03315302s) [upload=178943]: Done starting upload Jul 2 16:54:05.262549186 (223h43m40.033190521s) [upload=178943]: Uploading segments... Jul 2 16:54:05.262676380 (223h43m40.033317715s) [upload=178943]: Got next segment. Inline: false Jul 2 16:54:05.262704774 (223h43m40.033346109s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:54:05.262708992 (223h43m40.033350327s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:54:05.512996024 (223h43m40.283637359s) [seg_pos={0 0}, upload=178943]: Begin upload segment... Jul 2 16:54:05.513035330 (223h43m40.283676665s) [seg_pos={0 0}, upload=178943]: Done begin upload segment. Jul 2 16:54:05.513051209 (223h43m40.283692544s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513061560 (223h43m40.283702895s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513394557 (223h43m40.284035892s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513703728 (223h43m40.284345053s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513773561 (223h43m40.284414896s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513982151 (223h43m40.284623486s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514021205 (223h43m40.28466254s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514233051 (223h43m40.284874386s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514236677 (223h43m40.284878002s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514851123 (223h43m40.285492458s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514883755 (223h43m40.28552509s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515120498 (223h43m40.285761823s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515370256 (223h43m40.286011591s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516025430 (223h43m40.286666765s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516534103 (223h43m40.287175438s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.517178174 (223h43m40.28781951s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:07.112928981 (223h43m41.883570316s) [upload=178943]: Next returned nil segment Jul 2 16:54:07.112946585 (223h43m41.88358792s) [upload=178943]: Waiting for error group managing segments... Jul 2 16:54:07.457575995 (223h43m42.22821733s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.458802101 (223h43m42.229443436s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.466429934 (223h43m42.237071269s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.474520202 (223h43m42.245161527s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.488959054 (223h43m42.259600389s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.491690220 (223h43m42.262331555s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.503267458 (223h43m42.273908793s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.514613936 (223h43m42.285255271s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.531889065 (223h43m42.3025304s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.582720442 (223h43m42.353361767s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.584813677 (223h43m42.355455012s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.607187571 (223h43m42.377828896s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608616895 (223h43m42.37925824s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608631964 (223h43m42.379273299s) [seg_pos={0 0}, upload=178943]: Segment reached optimal threshold of 13 pieces. Jul 2 16:54:07.608785709 (223h43m42.379427034s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608881211 (223h43m42.379522546s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608968247 (223h43m42.379609572s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.609004217 (223h43m42.379645552s) [seg_pos={0 0}, upload=178943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:54:07.609097285 (223h43m42.37973862s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:54:07.609104839 (223h43m42.379746174s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:54:07.995690087 (223h43m42.766331422s) [upload=178943]: Done uploading segments... Jul 2 16:54:07.995712629 (223h43m42.766353974s) [upload=178943]: Upload finished. err: <nil> Duration: 5.67061245s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.905568099s FAIL (2025-07-02 16:58:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== l 2 16:53:34.097254581 (223h43m8.867895916s) [noise=true , address=77.90.31.13:4628 , piece_id=XMRK6IRQB7JXEMN7CXJOJHXUWZTOPOULFNYXOQIPLJHZD3NUBBVQ, seg_pos={0 0}, upload=178933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Jul 2 16:53:34.097307081 (223h43m8.867948416s) [seg_pos={0 0}, upload=178933]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:53:34.097386623 (223h43m8.868027959s) [upload=178933]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:53:34.097392004 (223h43m8.868033329s) [upload=178933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:53:34.419688729 (223h43m9.190330064s) [upload=178933]: Done uploading segments... Jul 2 16:53:34.419709358 (223h43m9.190350703s) [upload=178933]: Upload finished. err: <nil> Jul 2 16:54:05.262461990 (223h43m40.033103325s) [upload=178943]: Starting upload Jul 2 16:54:05.262511685 (223h43m40.03315302s) [upload=178943]: Done starting upload Jul 2 16:54:05.262549186 (223h43m40.033190521s) [upload=178943]: Uploading segments... Jul 2 16:54:05.262676380 (223h43m40.033317715s) [upload=178943]: Got next segment. Inline: false Jul 2 16:54:05.262704774 (223h43m40.033346109s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:54:05.262708992 (223h43m40.033350327s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:54:05.512996024 (223h43m40.283637359s) [seg_pos={0 0}, upload=178943]: Begin upload segment... Jul 2 16:54:05.513035330 (223h43m40.283676665s) [seg_pos={0 0}, upload=178943]: Done begin upload segment. Jul 2 16:54:05.513051209 (223h43m40.283692544s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513061560 (223h43m40.283702895s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513394557 (223h43m40.284035892s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513703728 (223h43m40.284345053s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513773561 (223h43m40.284414896s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513982151 (223h43m40.284623486s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514021205 (223h43m40.28466254s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514233051 (223h43m40.284874386s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514236677 (223h43m40.284878002s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514851123 (223h43m40.285492458s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514883755 (223h43m40.28552509s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515120498 (223h43m40.285761823s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515370256 (223h43m40.286011591s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516025430 (223h43m40.286666765s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516534103 (223h43m40.287175438s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.517178174 (223h43m40.28781951s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:07.112928981 (223h43m41.883570316s) [upload=178943]: Next returned nil segment Jul 2 16:54:07.112946585 (223h43m41.88358792s) [upload=178943]: Waiting for error group managing segments... Jul 2 16:54:07.457575995 (223h43m42.22821733s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.458802101 (223h43m42.229443436s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.466429934 (223h43m42.237071269s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.474520202 (223h43m42.245161527s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.488959054 (223h43m42.259600389s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.491690220 (223h43m42.262331555s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.503267458 (223h43m42.273908793s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.514613936 (223h43m42.285255271s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.531889065 (223h43m42.3025304s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.582720442 (223h43m42.353361767s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.584813677 (223h43m42.355455012s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.607187571 (223h43m42.377828896s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608616895 (223h43m42.37925824s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608631964 (223h43m42.379273299s) [seg_pos={0 0}, upload=178943]: Segment reached optimal threshold of 13 pieces. Jul 2 16:54:07.608785709 (223h43m42.379427034s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608881211 (223h43m42.379522546s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608968247 (223h43m42.379609572s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.609004217 (223h43m42.379645552s) [seg_pos={0 0}, upload=178943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:54:07.609097285 (223h43m42.37973862s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:54:07.609104839 (223h43m42.379746174s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:54:07.995690087 (223h43m42.766331422s) [upload=178943]: Done uploading segments... Jul 2 16:54:07.995712629 (223h43m42.766353974s) [upload=178943]: Upload finished. err: <nil> Duration: 5.905597356s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.79762415s FAIL (2025-07-02 16:58:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== l 2 16:53:34.097254581 (223h43m8.867895916s) [noise=true , address=77.90.31.13:4628 , piece_id=XMRK6IRQB7JXEMN7CXJOJHXUWZTOPOULFNYXOQIPLJHZD3NUBBVQ, seg_pos={0 0}, upload=178933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Jul 2 16:53:34.097307081 (223h43m8.867948416s) [seg_pos={0 0}, upload=178933]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:53:34.097386623 (223h43m8.868027959s) [upload=178933]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:53:34.097392004 (223h43m8.868033329s) [upload=178933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:53:34.419688729 (223h43m9.190330064s) [upload=178933]: Done uploading segments... Jul 2 16:53:34.419709358 (223h43m9.190350703s) [upload=178933]: Upload finished. err: <nil> Jul 2 16:54:05.262461990 (223h43m40.033103325s) [upload=178943]: Starting upload Jul 2 16:54:05.262511685 (223h43m40.03315302s) [upload=178943]: Done starting upload Jul 2 16:54:05.262549186 (223h43m40.033190521s) [upload=178943]: Uploading segments... Jul 2 16:54:05.262676380 (223h43m40.033317715s) [upload=178943]: Got next segment. Inline: false Jul 2 16:54:05.262704774 (223h43m40.033346109s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:54:05.262708992 (223h43m40.033350327s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:54:05.512996024 (223h43m40.283637359s) [seg_pos={0 0}, upload=178943]: Begin upload segment... Jul 2 16:54:05.513035330 (223h43m40.283676665s) [seg_pos={0 0}, upload=178943]: Done begin upload segment. Jul 2 16:54:05.513051209 (223h43m40.283692544s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513061560 (223h43m40.283702895s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513394557 (223h43m40.284035892s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513703728 (223h43m40.284345053s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513773561 (223h43m40.284414896s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513982151 (223h43m40.284623486s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514021205 (223h43m40.28466254s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514233051 (223h43m40.284874386s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514236677 (223h43m40.284878002s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514851123 (223h43m40.285492458s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514883755 (223h43m40.28552509s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515120498 (223h43m40.285761823s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515370256 (223h43m40.286011591s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516025430 (223h43m40.286666765s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516534103 (223h43m40.287175438s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.517178174 (223h43m40.28781951s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:07.112928981 (223h43m41.883570316s) [upload=178943]: Next returned nil segment Jul 2 16:54:07.112946585 (223h43m41.88358792s) [upload=178943]: Waiting for error group managing segments... Jul 2 16:54:07.457575995 (223h43m42.22821733s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.458802101 (223h43m42.229443436s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.466429934 (223h43m42.237071269s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.474520202 (223h43m42.245161527s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.488959054 (223h43m42.259600389s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.491690220 (223h43m42.262331555s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.503267458 (223h43m42.273908793s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.514613936 (223h43m42.285255271s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.531889065 (223h43m42.3025304s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.582720442 (223h43m42.353361767s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.584813677 (223h43m42.355455012s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.607187571 (223h43m42.377828896s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608616895 (223h43m42.37925824s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608631964 (223h43m42.379273299s) [seg_pos={0 0}, upload=178943]: Segment reached optimal threshold of 13 pieces. Jul 2 16:54:07.608785709 (223h43m42.379427034s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608881211 (223h43m42.379522546s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608968247 (223h43m42.379609572s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.609004217 (223h43m42.379645552s) [seg_pos={0 0}, upload=178943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:54:07.609097285 (223h43m42.37973862s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:54:07.609104839 (223h43m42.379746174s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:54:07.995690087 (223h43m42.766331422s) [upload=178943]: Done uploading segments... Jul 2 16:54:07.995712629 (223h43m42.766353974s) [upload=178943]: Upload finished. err: <nil> Duration: 5.79765518s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.918077094s FAIL (2025-07-02 16:56:56 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== l 2 16:53:34.097254581 (223h43m8.867895916s) [noise=true , address=77.90.31.13:4628 , piece_id=XMRK6IRQB7JXEMN7CXJOJHXUWZTOPOULFNYXOQIPLJHZD3NUBBVQ, seg_pos={0 0}, upload=178933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Jul 2 16:53:34.097307081 (223h43m8.867948416s) [seg_pos={0 0}, upload=178933]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:53:34.097386623 (223h43m8.868027959s) [upload=178933]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:53:34.097392004 (223h43m8.868033329s) [upload=178933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:53:34.419688729 (223h43m9.190330064s) [upload=178933]: Done uploading segments... Jul 2 16:53:34.419709358 (223h43m9.190350703s) [upload=178933]: Upload finished. err: <nil> Jul 2 16:54:05.262461990 (223h43m40.033103325s) [upload=178943]: Starting upload Jul 2 16:54:05.262511685 (223h43m40.03315302s) [upload=178943]: Done starting upload Jul 2 16:54:05.262549186 (223h43m40.033190521s) [upload=178943]: Uploading segments... Jul 2 16:54:05.262676380 (223h43m40.033317715s) [upload=178943]: Got next segment. Inline: false Jul 2 16:54:05.262704774 (223h43m40.033346109s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:54:05.262708992 (223h43m40.033350327s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:54:05.512996024 (223h43m40.283637359s) [seg_pos={0 0}, upload=178943]: Begin upload segment... Jul 2 16:54:05.513035330 (223h43m40.283676665s) [seg_pos={0 0}, upload=178943]: Done begin upload segment. Jul 2 16:54:05.513051209 (223h43m40.283692544s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513061560 (223h43m40.283702895s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513394557 (223h43m40.284035892s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513703728 (223h43m40.284345053s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513773561 (223h43m40.284414896s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513982151 (223h43m40.284623486s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514021205 (223h43m40.28466254s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514233051 (223h43m40.284874386s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514236677 (223h43m40.284878002s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514851123 (223h43m40.285492458s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514883755 (223h43m40.28552509s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515120498 (223h43m40.285761823s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515370256 (223h43m40.286011591s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516025430 (223h43m40.286666765s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516534103 (223h43m40.287175438s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.517178174 (223h43m40.28781951s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:07.112928981 (223h43m41.883570316s) [upload=178943]: Next returned nil segment Jul 2 16:54:07.112946585 (223h43m41.88358792s) [upload=178943]: Waiting for error group managing segments... Jul 2 16:54:07.457575995 (223h43m42.22821733s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.458802101 (223h43m42.229443436s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.466429934 (223h43m42.237071269s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.474520202 (223h43m42.245161527s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.488959054 (223h43m42.259600389s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.491690220 (223h43m42.262331555s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.503267458 (223h43m42.273908793s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.514613936 (223h43m42.285255271s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.531889065 (223h43m42.3025304s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.582720442 (223h43m42.353361767s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.584813677 (223h43m42.355455012s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.607187571 (223h43m42.377828896s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608616895 (223h43m42.37925824s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608631964 (223h43m42.379273299s) [seg_pos={0 0}, upload=178943]: Segment reached optimal threshold of 13 pieces. Jul 2 16:54:07.608785709 (223h43m42.379427034s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608881211 (223h43m42.379522546s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608968247 (223h43m42.379609572s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.609004217 (223h43m42.379645552s) [seg_pos={0 0}, upload=178943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:54:07.609097285 (223h43m42.37973862s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:54:07.609104839 (223h43m42.379746174s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:54:07.995690087 (223h43m42.766331422s) [upload=178943]: Done uploading segments... Jul 2 16:54:07.995712629 (223h43m42.766353974s) [upload=178943]: Upload finished. err: <nil> Duration: 5.918096321s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.737128093s FAIL (2025-07-02 16:56:20 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== l 2 16:53:34.097254581 (223h43m8.867895916s) [noise=true , address=77.90.31.13:4628 , piece_id=XMRK6IRQB7JXEMN7CXJOJHXUWZTOPOULFNYXOQIPLJHZD3NUBBVQ, seg_pos={0 0}, upload=178933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Jul 2 16:53:34.097307081 (223h43m8.867948416s) [seg_pos={0 0}, upload=178933]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:53:34.097386623 (223h43m8.868027959s) [upload=178933]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:53:34.097392004 (223h43m8.868033329s) [upload=178933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:53:34.419688729 (223h43m9.190330064s) [upload=178933]: Done uploading segments... Jul 2 16:53:34.419709358 (223h43m9.190350703s) [upload=178933]: Upload finished. err: <nil> Jul 2 16:54:05.262461990 (223h43m40.033103325s) [upload=178943]: Starting upload Jul 2 16:54:05.262511685 (223h43m40.03315302s) [upload=178943]: Done starting upload Jul 2 16:54:05.262549186 (223h43m40.033190521s) [upload=178943]: Uploading segments... Jul 2 16:54:05.262676380 (223h43m40.033317715s) [upload=178943]: Got next segment. Inline: false Jul 2 16:54:05.262704774 (223h43m40.033346109s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:54:05.262708992 (223h43m40.033350327s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:54:05.512996024 (223h43m40.283637359s) [seg_pos={0 0}, upload=178943]: Begin upload segment... Jul 2 16:54:05.513035330 (223h43m40.283676665s) [seg_pos={0 0}, upload=178943]: Done begin upload segment. Jul 2 16:54:05.513051209 (223h43m40.283692544s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513061560 (223h43m40.283702895s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513394557 (223h43m40.284035892s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513703728 (223h43m40.284345053s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513773561 (223h43m40.284414896s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513982151 (223h43m40.284623486s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514021205 (223h43m40.28466254s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514233051 (223h43m40.284874386s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514236677 (223h43m40.284878002s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514851123 (223h43m40.285492458s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514883755 (223h43m40.28552509s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515120498 (223h43m40.285761823s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515370256 (223h43m40.286011591s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516025430 (223h43m40.286666765s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516534103 (223h43m40.287175438s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.517178174 (223h43m40.28781951s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:07.112928981 (223h43m41.883570316s) [upload=178943]: Next returned nil segment Jul 2 16:54:07.112946585 (223h43m41.88358792s) [upload=178943]: Waiting for error group managing segments... Jul 2 16:54:07.457575995 (223h43m42.22821733s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.458802101 (223h43m42.229443436s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.466429934 (223h43m42.237071269s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.474520202 (223h43m42.245161527s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.488959054 (223h43m42.259600389s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.491690220 (223h43m42.262331555s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.503267458 (223h43m42.273908793s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.514613936 (223h43m42.285255271s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.531889065 (223h43m42.3025304s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.582720442 (223h43m42.353361767s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.584813677 (223h43m42.355455012s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.607187571 (223h43m42.377828896s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608616895 (223h43m42.37925824s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608631964 (223h43m42.379273299s) [seg_pos={0 0}, upload=178943]: Segment reached optimal threshold of 13 pieces. Jul 2 16:54:07.608785709 (223h43m42.379427034s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608881211 (223h43m42.379522546s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608968247 (223h43m42.379609572s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.609004217 (223h43m42.379645552s) [seg_pos={0 0}, upload=178943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:54:07.609097285 (223h43m42.37973862s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:54:07.609104839 (223h43m42.379746174s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:54:07.995690087 (223h43m42.766331422s) [upload=178943]: Done uploading segments... Jul 2 16:54:07.995712629 (223h43m42.766353974s) [upload=178943]: Upload finished. err: <nil> Duration: 5.737161267s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.596793983s FAIL (2025-07-02 16:55:50 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== l 2 16:53:34.097254581 (223h43m8.867895916s) [noise=true , address=77.90.31.13:4628 , piece_id=XMRK6IRQB7JXEMN7CXJOJHXUWZTOPOULFNYXOQIPLJHZD3NUBBVQ, seg_pos={0 0}, upload=178933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Jul 2 16:53:34.097307081 (223h43m8.867948416s) [seg_pos={0 0}, upload=178933]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:53:34.097386623 (223h43m8.868027959s) [upload=178933]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:53:34.097392004 (223h43m8.868033329s) [upload=178933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:53:34.419688729 (223h43m9.190330064s) [upload=178933]: Done uploading segments... Jul 2 16:53:34.419709358 (223h43m9.190350703s) [upload=178933]: Upload finished. err: <nil> Jul 2 16:54:05.262461990 (223h43m40.033103325s) [upload=178943]: Starting upload Jul 2 16:54:05.262511685 (223h43m40.03315302s) [upload=178943]: Done starting upload Jul 2 16:54:05.262549186 (223h43m40.033190521s) [upload=178943]: Uploading segments... Jul 2 16:54:05.262676380 (223h43m40.033317715s) [upload=178943]: Got next segment. Inline: false Jul 2 16:54:05.262704774 (223h43m40.033346109s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:54:05.262708992 (223h43m40.033350327s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:54:05.512996024 (223h43m40.283637359s) [seg_pos={0 0}, upload=178943]: Begin upload segment... Jul 2 16:54:05.513035330 (223h43m40.283676665s) [seg_pos={0 0}, upload=178943]: Done begin upload segment. Jul 2 16:54:05.513051209 (223h43m40.283692544s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513061560 (223h43m40.283702895s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513394557 (223h43m40.284035892s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513703728 (223h43m40.284345053s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513773561 (223h43m40.284414896s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513982151 (223h43m40.284623486s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514021205 (223h43m40.28466254s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514233051 (223h43m40.284874386s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514236677 (223h43m40.284878002s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514851123 (223h43m40.285492458s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514883755 (223h43m40.28552509s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515120498 (223h43m40.285761823s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515370256 (223h43m40.286011591s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516025430 (223h43m40.286666765s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516534103 (223h43m40.287175438s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.517178174 (223h43m40.28781951s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:07.112928981 (223h43m41.883570316s) [upload=178943]: Next returned nil segment Jul 2 16:54:07.112946585 (223h43m41.88358792s) [upload=178943]: Waiting for error group managing segments... Jul 2 16:54:07.457575995 (223h43m42.22821733s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.458802101 (223h43m42.229443436s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.466429934 (223h43m42.237071269s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.474520202 (223h43m42.245161527s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.488959054 (223h43m42.259600389s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.491690220 (223h43m42.262331555s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.503267458 (223h43m42.273908793s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.514613936 (223h43m42.285255271s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.531889065 (223h43m42.3025304s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.582720442 (223h43m42.353361767s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.584813677 (223h43m42.355455012s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.607187571 (223h43m42.377828896s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608616895 (223h43m42.37925824s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608631964 (223h43m42.379273299s) [seg_pos={0 0}, upload=178943]: Segment reached optimal threshold of 13 pieces. Jul 2 16:54:07.608785709 (223h43m42.379427034s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608881211 (223h43m42.379522546s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608968247 (223h43m42.379609572s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.609004217 (223h43m42.379645552s) [seg_pos={0 0}, upload=178943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:54:07.609097285 (223h43m42.37973862s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:54:07.609104839 (223h43m42.379746174s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:54:07.995690087 (223h43m42.766331422s) [upload=178943]: Done uploading segments... Jul 2 16:54:07.995712629 (223h43m42.766353974s) [upload=178943]: Upload finished. err: <nil> Duration: 5.596814503s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000338827s FAIL (2025-07-02 16:55:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== l 2 16:53:34.097254581 (223h43m8.867895916s) [noise=true , address=77.90.31.13:4628 , piece_id=XMRK6IRQB7JXEMN7CXJOJHXUWZTOPOULFNYXOQIPLJHZD3NUBBVQ, seg_pos={0 0}, upload=178933]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Jul 2 16:53:34.097307081 (223h43m8.867948416s) [seg_pos={0 0}, upload=178933]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:53:34.097386623 (223h43m8.868027959s) [upload=178933]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:53:34.097392004 (223h43m8.868033329s) [upload=178933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:53:34.419688729 (223h43m9.190330064s) [upload=178933]: Done uploading segments... Jul 2 16:53:34.419709358 (223h43m9.190350703s) [upload=178933]: Upload finished. err: <nil> Jul 2 16:54:05.262461990 (223h43m40.033103325s) [upload=178943]: Starting upload Jul 2 16:54:05.262511685 (223h43m40.03315302s) [upload=178943]: Done starting upload Jul 2 16:54:05.262549186 (223h43m40.033190521s) [upload=178943]: Uploading segments... Jul 2 16:54:05.262676380 (223h43m40.033317715s) [upload=178943]: Got next segment. Inline: false Jul 2 16:54:05.262704774 (223h43m40.033346109s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:54:05.262708992 (223h43m40.033350327s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:54:05.512996024 (223h43m40.283637359s) [seg_pos={0 0}, upload=178943]: Begin upload segment... Jul 2 16:54:05.513035330 (223h43m40.283676665s) [seg_pos={0 0}, upload=178943]: Done begin upload segment. Jul 2 16:54:05.513051209 (223h43m40.283692544s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513061560 (223h43m40.283702895s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513394557 (223h43m40.284035892s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513703728 (223h43m40.284345053s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513773561 (223h43m40.284414896s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.513982151 (223h43m40.284623486s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514021205 (223h43m40.28466254s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514233051 (223h43m40.284874386s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514236677 (223h43m40.284878002s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514851123 (223h43m40.285492458s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.514883755 (223h43m40.28552509s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515120498 (223h43m40.285761823s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.515370256 (223h43m40.286011591s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516025430 (223h43m40.286666765s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.516534103 (223h43m40.287175438s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:05.517178174 (223h43m40.28781951s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Uploading piece... Jul 2 16:54:07.112928981 (223h43m41.883570316s) [upload=178943]: Next returned nil segment Jul 2 16:54:07.112946585 (223h43m41.88358792s) [upload=178943]: Waiting for error group managing segments... Jul 2 16:54:07.457575995 (223h43m42.22821733s) [noise=true , address=104.36.82.13:4186 , piece_id=RDUZYI4ZIMHJOVCPITSYXP3CSWDAHJOIEXO3MGCGERCVASMUJSFA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.458802101 (223h43m42.229443436s) [noise=true , address=104.36.82.10:4079 , piece_id=JJKSDFXZOD2ENTWHHP6SUZEAAZGNNN4IM666NJ4WCV2CM227H72A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.466429934 (223h43m42.237071269s) [noise=true , address=104.36.82.11:4115 , piece_id=TPUNGN5NPZJQJBT4UZLIZSUT5HOHPGJIIFFWZJXJS5EVIQ23NKHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.474520202 (223h43m42.245161527s) [noise=true , address=104.36.82.9:4006 , piece_id=2UAR4BOSXE6CGDL4ABPEMO7MPWD2OWYAOMRJ37UNZJAF6SKZZ6BA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.488959054 (223h43m42.259600389s) [noise=true , address=104.36.82.14:4222 , piece_id=7TZ6E5X756SYA2HBJS7YKHHEN2XPZOQBLLOZFCKILN3EPROGNGOA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.491690220 (223h43m42.262331555s) [noise=true , address=104.36.82.8:4972 , piece_id=DFR3IP4T4MDTVGF5V6P6VE5SY2FG5XOSSNNH3RIUJ6AXFPQSEZQA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.503267458 (223h43m42.273908793s) [noise=true , address=104.36.82.7:4912 , piece_id=BZREKTJMJB7HSVRVYZAMZFQKXSK6MWDPYMJAKWOBTVM5HO5NLPRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.514613936 (223h43m42.285255271s) [noise=true , address=104.36.82.15:4259 , piece_id=RYBTGQXRTINIJQCGSZMMIEXFS6Q2I5A7IXZUOREK3TOY2T3BEPRQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.531889065 (223h43m42.3025304s) [noise=true , address=104.36.82.7:4911 , piece_id=SUQQYFCXDQTI7HCZDHR53SFRNAAE3PZYINZLOT6NYNWAHXGHTJNQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.582720442 (223h43m42.353361767s) [noise=true , address=104.36.82.4:4801 , piece_id=NWH42PADWTEBGLML25LBC7N4LXJWL4F2G3EISFJFFWNB2GCN7NHA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.584813677 (223h43m42.355455012s) [noise=true , address=45.91.116.6:4973 , piece_id=LZ527XSEHHZSQGIZEFTM7W7UUDRU7DY366V22DSIF3O7SVZETBJA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.607187571 (223h43m42.377828896s) [noise=true , address=77.90.31.19:4842 , piece_id=4AYWI756KXIJGDT57RIY7HXL6DLNOJKHDJPXZVEGEBCEQCWYBIHQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608616895 (223h43m42.37925824s) [noise=true , address=77.90.31.16:4734 , piece_id=6BN6SSHMCDDPZLVVJ6CAWQV5FFAHNFIQAULDMMYI63JLDO5HVODQ, seg_pos={0 0}, upload=178943]: Done uploading piece. err: <nil> Jul 2 16:54:07.608631964 (223h43m42.379273299s) [seg_pos={0 0}, upload=178943]: Segment reached optimal threshold of 13 pieces. Jul 2 16:54:07.608785709 (223h43m42.379427034s) [noise=true , address=45.91.116.5:4297 , piece_id=CQHM6T74GPL6JIEZ5YYZLBVESYT3O2A76CZJCKV3NGRSOR5BMV4Q, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608881211 (223h43m42.379522546s) [noise=true , address=45.91.116.12:4226 , piece_id=7XR3OU6KKUINFBTHVLYLHTYXKS5TL3MQ4G46GN7UJMKGA52K6JRA, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.608968247 (223h43m42.379609572s) [noise=true , address=45.91.116.8:4045 , piece_id=6GK64WE6N372L2GR34EJIUC7OQUXWAIBNLS5MU3B2M2EPV75Q65A, seg_pos={0 0}, upload=178943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Jul 2 16:54:07.609004217 (223h43m42.379645552s) [seg_pos={0 0}, upload=178943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:54:07.609097285 (223h43m42.37973862s) [upload=178943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:54:07.609104839 (223h43m42.379746174s) [upload=178943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:54:07.995690087 (223h43m42.766331422s) [upload=178943]: Done uploading segments... Jul 2 16:54:07.995712629 (223h43m42.766353974s) [upload=178943]: Upload finished. err: <nil> Duration: 30.000351942s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.453165342s FAIL (2025-07-02 16:17:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.453203054s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.464392589s FAIL (2025-07-02 16:17:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.464445059s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.527614964s FAIL (2025-07-02 16:16:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.527705308s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X..X........................................................] duration: 5.506276811s FAIL (2025-07-02 16:15:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.506292982s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.X..X.......................................................] duration: 5.503358606s FAIL (2025-07-02 16:14:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.503378855s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..X..X......................................................] duration: 5.434117168s FAIL (2025-07-02 16:13:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.43415942s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...X..X.....................................................] duration: 5.703649265s FAIL (2025-07-02 16:12:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.703670024s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....X..X....................................................] duration: 6.656260936s FAIL (2025-07-02 16:11:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.656284422s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....X..X...................................................] duration: 5.587140506s FAIL (2025-07-02 16:11:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.587193276s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......X..X..................................................] duration: 5.679258523s FAIL (2025-07-02 16:10:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.679281579s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......X..X.................................................] duration: 5.472510435s FAIL (2025-07-02 16:10:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.472535351s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........X..X................................................] duration: 5.612494331s FAIL (2025-07-02 16:09:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.61250883s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........X..X...............................................] duration: 5.479252841s FAIL (2025-07-02 16:09:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.479280886s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........X..X..............................................] duration: 5.474280568s FAIL (2025-07-02 16:08:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.474303202s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........X..X.............................................] duration: 6.566565619s FAIL (2025-07-02 16:07:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.566586328s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............X..X............................................] duration: 5.563611411s FAIL (2025-07-02 16:06:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.563640267s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............X..X...........................................] duration: 5.423879914s FAIL (2025-07-02 16:05:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.423899863s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............X..X..........................................] duration: 5.480016325s FAIL (2025-07-02 16:05:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.480037605s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............X..X.........................................] duration: 5.744321039s FAIL (2025-07-02 16:04:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.744340255s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................X..X........................................] duration: 5.781777474s FAIL (2025-07-02 16:03:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.781798285s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................X..X.......................................] duration: 5.457421484s FAIL (2025-07-02 16:03:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.457446351s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................X..X......................................] duration: 5.621195451s FAIL (2025-07-02 16:03:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.621312304s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................X..X.....................................] duration: 6.681640044s FAIL (2025-07-02 16:02:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.681665634s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................X..X....................................] duration: 5.552381529s FAIL (2025-07-02 16:00:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.552400565s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................X..X...................................] duration: 5.70343652s FAIL (2025-07-02 16:00:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.703465445s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................X..X..................................] duration: 5.524091476s FAIL (2025-07-02 15:59:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.524111094s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................X..X.................................] duration: 5.492679189s FAIL (2025-07-02 15:58:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.492710269s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................X..X................................] duration: 5.472546212s FAIL (2025-07-02 15:57:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.47256652s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..X...............................] duration: 5.421059288s FAIL (2025-07-02 15:56:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.421081069s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................X..X..............................] duration: 5.489964016s FAIL (2025-07-02 15:55:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.489985536s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........................X..X.............................] duration: 5.539818013s FAIL (2025-07-02 15:54:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.539838222s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............................X..X............................] duration: 6.766339479s FAIL (2025-07-02 15:54:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.766362725s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..X...........................] duration: 5.482649715s FAIL (2025-07-02 15:53:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.48266875s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..X..........................] duration: 5.532237486s FAIL (2025-07-02 15:52:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.532264688s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..X.........................] duration: 5.624602952s FAIL (2025-07-02 15:51:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.624618631s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................................X..X........................] duration: 5.753633638s FAIL (2025-07-02 15:50:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.753657052s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................................X..X.......................] duration: 5.478870001s FAIL (2025-07-02 15:50:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.478892062s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................................X..X......................] duration: 5.379153438s FAIL (2025-07-02 15:49:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.379174959s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................................X..X.....................] duration: 5.694117144s FAIL (2025-07-02 15:48:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.694139466s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................................X..X....................] duration: 5.716944382s FAIL (2025-07-02 15:47:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.716967287s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X..X...................] duration: 5.632636982s FAIL (2025-07-02 15:47:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.633007771s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [X.....................................X..X..................] duration: 5.489266918s FAIL (2025-07-02 15:46:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.489288639s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)