Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X...X....] duration: 6.443500748s FAIL (2025-10-14 12:04:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, Piece ID: RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ) context deadline exceeded; piecestore: (Node ID: 12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, Piece ID: V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A) context deadline exceeded; piecestore: (Node ID: 138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, Piece ID: IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA) context deadline exceeded ======LOGS====== Oct 14 12:02:07.406181333 (502h30m52.868273816s) [upload=442154]: Starting upload Oct 14 12:02:07.406287014 (502h30m52.868379497s) [upload=442154]: Done starting upload Oct 14 12:02:07.406510380 (502h30m52.868602873s) [upload=442154]: Uploading segments... Oct 14 12:02:07.406584972 (502h30m52.868677455s) [upload=442154]: Got next segment. Inline: false Oct 14 12:02:07.406619418 (502h30m52.868711901s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 14 12:02:07.406625409 (502h30m52.868717892s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 14 12:02:07.653201299 (502h30m53.115293783s) [seg_pos={0 0}, upload=442154]: Begin upload segment... Oct 14 12:02:07.653266985 (502h30m53.115359508s) [seg_pos={0 0}, upload=442154]: Done begin upload segment. Oct 14 12:02:07.653308183 (502h30m53.115400656s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.653338511 (502h30m53.115430994s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654036620 (502h30m53.116129103s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654052150 (502h30m53.116144643s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654498200 (502h30m53.116590683s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654597077 (502h30m53.11668956s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655180819 (502h30m53.117273292s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655343599 (502h30m53.117436082s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655677485 (502h30m53.117769968s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655840064 (502h30m53.117932547s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656103216 (502h30m53.118195699s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656461808 (502h30m53.118554281s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656609881 (502h30m53.118702374s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656864105 (502h30m53.118956588s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657269527 (502h30m53.11936201s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657424352 (502h30m53.119516835s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:09.214328690 (502h30m54.676421163s) [upload=442154]: Next returned nil segment Oct 14 12:02:09.214349711 (502h30m54.676442194s) [upload=442154]: Waiting for error group managing segments... Oct 14 12:02:09.585448584 (502h30m55.047541067s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.588779828 (502h30m55.050872311s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.591713885 (502h30m55.053806368s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.598663980 (502h30m55.060756463s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.864904387 (502h30m55.32699687s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.931004488 (502h30m55.393096971s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.964844578 (502h30m55.426937051s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.214938067 (502h30m55.67703622s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.445666571 (502h30m55.907759054s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.557888649 (502h30m56.019981132s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.766740675 (502h30m56.228833148s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.212624628 (502h30m56.674717111s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523339557 (502h30m56.98543204s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523366689 (502h30m56.985459172s) [seg_pos={0 0}, upload=442154]: Segment reached optimal threshold of 13 pieces. Oct 14 12:02:11.523509430 (502h30m56.985601913s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523520451 (502h30m56.985612934s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523642033 (502h30m56.985734516s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523650669 (502h30m56.985743142s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523747263 (502h30m56.985839746s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523755549 (502h30m56.985848032s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523774075 (502h30m56.985866558s) [seg_pos={0 0}, upload=442154]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 14 12:02:11.523860288 (502h30m56.985952771s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 14 12:02:11.523866841 (502h30m56.985959324s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 14 12:02:12.023733160 (502h30m57.485825653s) [upload=442154]: Done uploading segments... Oct 14 12:02:12.023759439 (502h30m57.485851922s) [upload=442154]: Upload finished. err: <nil> Duration: 6.443533451s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X...X...] duration: 7.557487339s FAIL (2025-10-14 12:04:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, Piece ID: RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ) context deadline exceeded; piecestore: (Node ID: 12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, Piece ID: V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A) context deadline exceeded; piecestore: (Node ID: 138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, Piece ID: IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA) context deadline exceeded ======LOGS====== Oct 14 12:02:07.406181333 (502h30m52.868273816s) [upload=442154]: Starting upload Oct 14 12:02:07.406287014 (502h30m52.868379497s) [upload=442154]: Done starting upload Oct 14 12:02:07.406510380 (502h30m52.868602873s) [upload=442154]: Uploading segments... Oct 14 12:02:07.406584972 (502h30m52.868677455s) [upload=442154]: Got next segment. Inline: false Oct 14 12:02:07.406619418 (502h30m52.868711901s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 14 12:02:07.406625409 (502h30m52.868717892s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 14 12:02:07.653201299 (502h30m53.115293783s) [seg_pos={0 0}, upload=442154]: Begin upload segment... Oct 14 12:02:07.653266985 (502h30m53.115359508s) [seg_pos={0 0}, upload=442154]: Done begin upload segment. Oct 14 12:02:07.653308183 (502h30m53.115400656s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.653338511 (502h30m53.115430994s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654036620 (502h30m53.116129103s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654052150 (502h30m53.116144643s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654498200 (502h30m53.116590683s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654597077 (502h30m53.11668956s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655180819 (502h30m53.117273292s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655343599 (502h30m53.117436082s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655677485 (502h30m53.117769968s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655840064 (502h30m53.117932547s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656103216 (502h30m53.118195699s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656461808 (502h30m53.118554281s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656609881 (502h30m53.118702374s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656864105 (502h30m53.118956588s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657269527 (502h30m53.11936201s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657424352 (502h30m53.119516835s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:09.214328690 (502h30m54.676421163s) [upload=442154]: Next returned nil segment Oct 14 12:02:09.214349711 (502h30m54.676442194s) [upload=442154]: Waiting for error group managing segments... Oct 14 12:02:09.585448584 (502h30m55.047541067s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.588779828 (502h30m55.050872311s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.591713885 (502h30m55.053806368s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.598663980 (502h30m55.060756463s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.864904387 (502h30m55.32699687s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.931004488 (502h30m55.393096971s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.964844578 (502h30m55.426937051s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.214938067 (502h30m55.67703622s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.445666571 (502h30m55.907759054s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.557888649 (502h30m56.019981132s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.766740675 (502h30m56.228833148s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.212624628 (502h30m56.674717111s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523339557 (502h30m56.98543204s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523366689 (502h30m56.985459172s) [seg_pos={0 0}, upload=442154]: Segment reached optimal threshold of 13 pieces. Oct 14 12:02:11.523509430 (502h30m56.985601913s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523520451 (502h30m56.985612934s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523642033 (502h30m56.985734516s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523650669 (502h30m56.985743142s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523747263 (502h30m56.985839746s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523755549 (502h30m56.985848032s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523774075 (502h30m56.985866558s) [seg_pos={0 0}, upload=442154]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 14 12:02:11.523860288 (502h30m56.985952771s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 14 12:02:11.523866841 (502h30m56.985959324s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 14 12:02:12.023733160 (502h30m57.485825653s) [upload=442154]: Done uploading segments... Oct 14 12:02:12.023759439 (502h30m57.485851922s) [upload=442154]: Upload finished. err: <nil> Duration: 7.557521865s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X...X..] duration: 9.499589104s FAIL (2025-10-14 12:03:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, Piece ID: RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ) context deadline exceeded; piecestore: (Node ID: 12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, Piece ID: V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A) context deadline exceeded; piecestore: (Node ID: 138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, Piece ID: IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA) context deadline exceeded ======LOGS====== Oct 14 12:02:07.406181333 (502h30m52.868273816s) [upload=442154]: Starting upload Oct 14 12:02:07.406287014 (502h30m52.868379497s) [upload=442154]: Done starting upload Oct 14 12:02:07.406510380 (502h30m52.868602873s) [upload=442154]: Uploading segments... Oct 14 12:02:07.406584972 (502h30m52.868677455s) [upload=442154]: Got next segment. Inline: false Oct 14 12:02:07.406619418 (502h30m52.868711901s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 14 12:02:07.406625409 (502h30m52.868717892s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 14 12:02:07.653201299 (502h30m53.115293783s) [seg_pos={0 0}, upload=442154]: Begin upload segment... Oct 14 12:02:07.653266985 (502h30m53.115359508s) [seg_pos={0 0}, upload=442154]: Done begin upload segment. Oct 14 12:02:07.653308183 (502h30m53.115400656s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.653338511 (502h30m53.115430994s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654036620 (502h30m53.116129103s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654052150 (502h30m53.116144643s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654498200 (502h30m53.116590683s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654597077 (502h30m53.11668956s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655180819 (502h30m53.117273292s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655343599 (502h30m53.117436082s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655677485 (502h30m53.117769968s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655840064 (502h30m53.117932547s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656103216 (502h30m53.118195699s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656461808 (502h30m53.118554281s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656609881 (502h30m53.118702374s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656864105 (502h30m53.118956588s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657269527 (502h30m53.11936201s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657424352 (502h30m53.119516835s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:09.214328690 (502h30m54.676421163s) [upload=442154]: Next returned nil segment Oct 14 12:02:09.214349711 (502h30m54.676442194s) [upload=442154]: Waiting for error group managing segments... Oct 14 12:02:09.585448584 (502h30m55.047541067s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.588779828 (502h30m55.050872311s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.591713885 (502h30m55.053806368s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.598663980 (502h30m55.060756463s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.864904387 (502h30m55.32699687s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.931004488 (502h30m55.393096971s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.964844578 (502h30m55.426937051s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.214938067 (502h30m55.67703622s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.445666571 (502h30m55.907759054s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.557888649 (502h30m56.019981132s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.766740675 (502h30m56.228833148s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.212624628 (502h30m56.674717111s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523339557 (502h30m56.98543204s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523366689 (502h30m56.985459172s) [seg_pos={0 0}, upload=442154]: Segment reached optimal threshold of 13 pieces. Oct 14 12:02:11.523509430 (502h30m56.985601913s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523520451 (502h30m56.985612934s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523642033 (502h30m56.985734516s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523650669 (502h30m56.985743142s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523747263 (502h30m56.985839746s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523755549 (502h30m56.985848032s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523774075 (502h30m56.985866558s) [seg_pos={0 0}, upload=442154]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 14 12:02:11.523860288 (502h30m56.985952771s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 14 12:02:11.523866841 (502h30m56.985959324s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 14 12:02:12.023733160 (502h30m57.485825653s) [upload=442154]: Done uploading segments... Oct 14 12:02:12.023759439 (502h30m57.485851922s) [upload=442154]: Upload finished. err: <nil> Duration: 9.499620062s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X...X.] duration: 12.218523708s FAIL (2025-10-14 12:03:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, Piece ID: RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ) context deadline exceeded; piecestore: (Node ID: 12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, Piece ID: V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A) context deadline exceeded; piecestore: (Node ID: 138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, Piece ID: IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA) context deadline exceeded ======LOGS====== Oct 14 12:02:07.406181333 (502h30m52.868273816s) [upload=442154]: Starting upload Oct 14 12:02:07.406287014 (502h30m52.868379497s) [upload=442154]: Done starting upload Oct 14 12:02:07.406510380 (502h30m52.868602873s) [upload=442154]: Uploading segments... Oct 14 12:02:07.406584972 (502h30m52.868677455s) [upload=442154]: Got next segment. Inline: false Oct 14 12:02:07.406619418 (502h30m52.868711901s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 14 12:02:07.406625409 (502h30m52.868717892s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 14 12:02:07.653201299 (502h30m53.115293783s) [seg_pos={0 0}, upload=442154]: Begin upload segment... Oct 14 12:02:07.653266985 (502h30m53.115359508s) [seg_pos={0 0}, upload=442154]: Done begin upload segment. Oct 14 12:02:07.653308183 (502h30m53.115400656s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.653338511 (502h30m53.115430994s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654036620 (502h30m53.116129103s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654052150 (502h30m53.116144643s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654498200 (502h30m53.116590683s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654597077 (502h30m53.11668956s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655180819 (502h30m53.117273292s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655343599 (502h30m53.117436082s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655677485 (502h30m53.117769968s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655840064 (502h30m53.117932547s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656103216 (502h30m53.118195699s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656461808 (502h30m53.118554281s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656609881 (502h30m53.118702374s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656864105 (502h30m53.118956588s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657269527 (502h30m53.11936201s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657424352 (502h30m53.119516835s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:09.214328690 (502h30m54.676421163s) [upload=442154]: Next returned nil segment Oct 14 12:02:09.214349711 (502h30m54.676442194s) [upload=442154]: Waiting for error group managing segments... Oct 14 12:02:09.585448584 (502h30m55.047541067s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.588779828 (502h30m55.050872311s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.591713885 (502h30m55.053806368s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.598663980 (502h30m55.060756463s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.864904387 (502h30m55.32699687s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.931004488 (502h30m55.393096971s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.964844578 (502h30m55.426937051s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.214938067 (502h30m55.67703622s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.445666571 (502h30m55.907759054s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.557888649 (502h30m56.019981132s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.766740675 (502h30m56.228833148s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.212624628 (502h30m56.674717111s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523339557 (502h30m56.98543204s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523366689 (502h30m56.985459172s) [seg_pos={0 0}, upload=442154]: Segment reached optimal threshold of 13 pieces. Oct 14 12:02:11.523509430 (502h30m56.985601913s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523520451 (502h30m56.985612934s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523642033 (502h30m56.985734516s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523650669 (502h30m56.985743142s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523747263 (502h30m56.985839746s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523755549 (502h30m56.985848032s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523774075 (502h30m56.985866558s) [seg_pos={0 0}, upload=442154]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 14 12:02:11.523860288 (502h30m56.985952771s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 14 12:02:11.523866841 (502h30m56.985959324s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 14 12:02:12.023733160 (502h30m57.485825653s) [upload=442154]: Done uploading segments... Oct 14 12:02:12.023759439 (502h30m57.485851922s) [upload=442154]: Upload finished. err: <nil> Duration: 12.218554787s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X...X] duration: 30.00214604s FAIL (2025-10-14 12:02:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, Piece ID: RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ) context deadline exceeded; piecestore: (Node ID: 12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, Piece ID: V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A) context deadline exceeded; piecestore: (Node ID: 138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, Piece ID: IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA) context deadline exceeded ======LOGS====== Oct 14 12:02:07.406181333 (502h30m52.868273816s) [upload=442154]: Starting upload Oct 14 12:02:07.406287014 (502h30m52.868379497s) [upload=442154]: Done starting upload Oct 14 12:02:07.406510380 (502h30m52.868602873s) [upload=442154]: Uploading segments... Oct 14 12:02:07.406584972 (502h30m52.868677455s) [upload=442154]: Got next segment. Inline: false Oct 14 12:02:07.406619418 (502h30m52.868711901s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 14 12:02:07.406625409 (502h30m52.868717892s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 14 12:02:07.653201299 (502h30m53.115293783s) [seg_pos={0 0}, upload=442154]: Begin upload segment... Oct 14 12:02:07.653266985 (502h30m53.115359508s) [seg_pos={0 0}, upload=442154]: Done begin upload segment. Oct 14 12:02:07.653308183 (502h30m53.115400656s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.653338511 (502h30m53.115430994s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654036620 (502h30m53.116129103s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654052150 (502h30m53.116144643s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654498200 (502h30m53.116590683s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.654597077 (502h30m53.11668956s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655180819 (502h30m53.117273292s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655343599 (502h30m53.117436082s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655677485 (502h30m53.117769968s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.655840064 (502h30m53.117932547s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656103216 (502h30m53.118195699s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656461808 (502h30m53.118554281s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656609881 (502h30m53.118702374s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.656864105 (502h30m53.118956588s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657269527 (502h30m53.11936201s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:07.657424352 (502h30m53.119516835s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Uploading piece... Oct 14 12:02:09.214328690 (502h30m54.676421163s) [upload=442154]: Next returned nil segment Oct 14 12:02:09.214349711 (502h30m54.676442194s) [upload=442154]: Waiting for error group managing segments... Oct 14 12:02:09.585448584 (502h30m55.047541067s) [noise=true , address=145.79.227.15:4876 , piece_id=NJJVYAWMBWXN6NECRJDBN2RTISCKEU5R4BJLNOQ5SKIOIRXHXVQQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.588779828 (502h30m55.050872311s) [noise=true , address=145.79.227.3:4151 , piece_id=XY7KRFSVBAJ5YLTRCXQAZHUN3NZAE24H776DTV3QFBCK7GCUIPTA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.591713885 (502h30m55.053806368s) [noise=true , address=145.79.227.18:4007 , piece_id=J3ZJ5UVY52QKSGQRRHSVH7HMK6YQHSFNDEZQBCGCKEKAIZVCWU5A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.598663980 (502h30m55.060756463s) [noise=true , address=145.79.227.4:4186 , piece_id=SF5SGIOYJKOVYUXLFDAVE6TFZKKNK2S7AQTM4EKDNXZM5JP7ZMZA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.864904387 (502h30m55.32699687s) [noise=true , address=77.90.31.14:4662 , piece_id=IMFXBP24LNIKWFY2EK737YJU4OHAYXIIXXCMLG4IBS46JC2SVGNA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.931004488 (502h30m55.393096971s) [noise=true , address=77.90.31.13:4628 , piece_id=FATBBXJJR7ZUIHNQTBSEYWN7EY46OBCCJMKOAL3TOFBOURA76F6Q, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:09.964844578 (502h30m55.426937051s) [noise=true , address=77.90.31.12:4590 , piece_id=F23JIRYKYSS4SMHX5ZTEVZSQYPLSROT7JJP4OG4PZ4MSKPYLLGUQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.214938067 (502h30m55.67703622s) [noise=true , address=145.79.227.6:4258 , piece_id=2NDUTCCB7OIXB5VQIK5JEO53P2O7DUXM7XQJSEVYFFBNHTZKQZOQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.445666571 (502h30m55.907759054s) [noise=true , address=45.91.116.12:4225 , piece_id=A7TIRRD5WHF3N2YUXXTVVDOQWYUSIHFOPNI6JC6EPRH2HVSQDMQA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.557888649 (502h30m56.019981132s) [noise=true , address=45.91.116.11:4118 , piece_id=GCRGM3C3BWX4BJQSEXGBWZYI6EGFX67LUM52LB2F63AIG72WUPRA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:10.766740675 (502h30m56.228833148s) [noise=true , address=45.91.116.13:4155 , piece_id=RQBKE6WVQ7Y5LTSNJDSIONMAFOGKEN3CSZ4QT2433IDX6H6RVMAQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.212624628 (502h30m56.674717111s) [noise=true , address=45.91.116.6:4974 , piece_id=V5SIWAF53GGTXW3B4VAPENVVXKGELLMGN3HACXNMXKBM23KEGW4A, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523339557 (502h30m56.98543204s) [noise=true , address=45.91.116.14:4189 , piece_id=EKPU7Q6DQZRI4XOK2YKDL2BZR5KRD5U36MBQZYVVA747HAA47EDA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: <nil> Oct 14 12:02:11.523366689 (502h30m56.985459172s) [seg_pos={0 0}, upload=442154]: Segment reached optimal threshold of 13 pieces. Oct 14 12:02:11.523509430 (502h30m56.985601913s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523520451 (502h30m56.985612934s) [noise=true , address=45.91.116.8:4048 , piece_id=LS2RTCVJ4EDMIJYXVP5GHE7KOJATMZGEAAIF3MFLYV2NQ2ZRAFXQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523642033 (502h30m56.985734516s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523650669 (502h30m56.985743142s) [noise=true , address=45.91.116.4:4937 , piece_id=FVNBXD27MGJCKQN5YGOEFWQRSY6IIGHS6JREV7ZNR3DPWDFPS7CQ, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523747263 (502h30m56.985839746s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: expected piece hash; context canceled; EOF Oct 14 12:02:11.523755549 (502h30m56.985848032s) [noise=true , address=45.91.116.8:4045 , piece_id=6PG4QQY432JXXT7XKYW6KCL2E4BJ6PEPOLJUAGOR77CMG4WXXLPA, seg_pos={0 0}, upload=442154]: Long tail cancellation due to optimal threshold Oct 14 12:02:11.523774075 (502h30m56.985866558s) [seg_pos={0 0}, upload=442154]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 14 12:02:11.523860288 (502h30m56.985952771s) [upload=442154]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 14 12:02:11.523866841 (502h30m56.985959324s) [upload=442154]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 14 12:02:12.023733160 (502h30m57.485825653s) [upload=442154]: Done uploading segments... Oct 14 12:02:12.023759439 (502h30m57.485851922s) [upload=442154]: Upload finished. err: <nil> Duration: 30.002165576s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 7.053065735s FAIL (2025-10-14 12:01:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 11:58:56.900661948 (502h27m42.362754431s) [upload=442109]: Starting upload Oct 14 11:58:56.900736511 (502h27m42.362828984s) [upload=442109]: Done starting upload Oct 14 11:58:56.900957481 (502h27m42.363049954s) [upload=442109]: Uploading segments... Oct 14 11:58:56.901011053 (502h27m42.363103536s) [upload=442109]: Got next segment. Inline: false Oct 14 11:58:56.901061008 (502h27m42.363153482s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 14 11:58:56.901069745 (502h27m42.363162258s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 14 11:58:57.204051874 (502h27m42.666144378s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Oct 14 11:58:57.204118782 (502h27m42.666211275s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Oct 14 11:58:57.204146634 (502h27m42.666239117s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204166282 (502h27m42.666258755s) [noise=true , address=45.91.116.4:4939 , piece_id=ZNSLVMHPEVTRY4ZKHVIVWNON3SONWQ6F7FZ3ZT4R7LP2ZYINR2NA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204763349 (502h27m42.666855832s) [noise=true , address=45.91.116.9:4262 , piece_id=BRRLIWDW4PFYEA6I3JXGXWDVYNXRICVOE7RD6ZWZB6MRBJOTD7CQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204924586 (502h27m42.667017059s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.205301294 (502h27m42.667393777s) [noise=true , address=45.91.116.5:4298 , piece_id=GXKI4Y57BU3HF5W7BL7MCDSEKIRFZH7QGYTXOJPZTKEH5AYYA4MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.205679944 (502h27m42.667772427s) [noise=true , address=145.79.227.4:4186 , piece_id=RYLIEI3SPEKF7WGP5ZR3WSVHJ7XMCB6QOGORM5UCO6DDKBVPUA7Q, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206122256 (502h27m42.668214729s) [noise=true , address=145.79.227.3:4151 , piece_id=4MI3TGFP2YODG437SEQO3OUC4AWIIMFFJWKLHLBSO6IOOIJXEVJA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206193091 (502h27m42.668285574s) [noise=true , address=145.79.227.11:4730 , piece_id=5BWLW7QCCA7RZIKLUADIJMUKBV66K3V3GHY2M5AVSL5BV6JYVTJA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206543268 (502h27m42.668635751s) [noise=true , address=145.79.227.11:4731 , piece_id=HIQL5Z43ORQ5JGFHBH7Y5M3MSMTBQ75435FCVEFPCHPR77QC6YZQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206593504 (502h27m42.668685987s) [noise=true , address=77.90.31.11:4553 , piece_id=FDRYYKRC7T35MV5GVNITLUK7RAQM6JK7P2UHN6JAYP4TLPUDMUFA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206929193 (502h27m42.669021676s) [noise=true , address=145.79.227.16:4912 , piece_id=Z4SA2D3PBZIXHR64UJO7S65F7LF3TWMSYEXPJ5P5PFXQYL47ZMDA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207018313 (502h27m42.669110796s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207303506 (502h27m42.669395979s) [noise=true , address=77.90.31.15:4697 , piece_id=ENLPKMJUMTZBA2HU6MFI7MS6I6J2CFN5MDHW3AENGO3N65ED5ZNQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207580313 (502h27m42.669672796s) [noise=true , address=145.79.227.15:4874 , piece_id=VWU5L73HQZXWKXFOKYVFCY5Y5DRD76YYNM72VWSGBT5LUQJTMZ6A, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207663471 (502h27m42.669755954s) [noise=true , address=145.79.227.18:4007 , piece_id=Q5YBDDBEPAZVCIR7H767D7G375KHWNEQN2YK7CWMLD4MDG5BSZTA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.208090354 (502h27m42.670182837s) [noise=true , address=145.79.227.2:4114 , piece_id=SI3A5IMZC656H37RPWL7FZR3NL43OIIS5FVPGJDDBOY6XLC5RBTQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:58.867835816 (502h27m44.329928309s) [upload=442109]: Next returned nil segment Oct 14 11:58:58.867863900 (502h27m44.329956383s) [upload=442109]: Waiting for error group managing segments... Oct 14 11:58:59.140114690 (502h27m44.602207173s) [noise=true , address=145.79.227.3:4151 , piece_id=4MI3TGFP2YODG437SEQO3OUC4AWIIMFFJWKLHLBSO6IOOIJXEVJA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.142057810 (502h27m44.604150293s) [noise=true , address=145.79.227.11:4730 , piece_id=5BWLW7QCCA7RZIKLUADIJMUKBV66K3V3GHY2M5AVSL5BV6JYVTJA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.142291204 (502h27m44.604383677s) [noise=true , address=145.79.227.18:4007 , piece_id=Q5YBDDBEPAZVCIR7H767D7G375KHWNEQN2YK7CWMLD4MDG5BSZTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.145197940 (502h27m44.607290423s) [noise=true , address=145.79.227.2:4114 , piece_id=SI3A5IMZC656H37RPWL7FZR3NL43OIIS5FVPGJDDBOY6XLC5RBTQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.145240631 (502h27m44.607333114s) [noise=true , address=145.79.227.16:4912 , piece_id=Z4SA2D3PBZIXHR64UJO7S65F7LF3TWMSYEXPJ5P5PFXQYL47ZMDA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.147505103 (502h27m44.609597576s) [noise=true , address=145.79.227.11:4731 , piece_id=HIQL5Z43ORQ5JGFHBH7Y5M3MSMTBQ75435FCVEFPCHPR77QC6YZQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.147661310 (502h27m44.609753783s) [noise=true , address=145.79.227.15:4874 , piece_id=VWU5L73HQZXWKXFOKYVFCY5Y5DRD76YYNM72VWSGBT5LUQJTMZ6A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.205186871 (502h27m44.667279354s) [noise=true , address=145.79.227.4:4186 , piece_id=RYLIEI3SPEKF7WGP5ZR3WSVHJ7XMCB6QOGORM5UCO6DDKBVPUA7Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.409850571 (502h27m44.871943044s) [noise=true , address=77.90.31.15:4697 , piece_id=ENLPKMJUMTZBA2HU6MFI7MS6I6J2CFN5MDHW3AENGO3N65ED5ZNQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.513777600 (502h27m44.975870083s) [noise=true , address=77.90.31.11:4553 , piece_id=FDRYYKRC7T35MV5GVNITLUK7RAQM6JK7P2UHN6JAYP4TLPUDMUFA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.432518552 (502h27m46.894611035s) [noise=true , address=45.91.116.5:4298 , piece_id=GXKI4Y57BU3HF5W7BL7MCDSEKIRFZH7QGYTXOJPZTKEH5AYYA4MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.522324560 (502h27m46.984417044s) [noise=true , address=45.91.116.9:4262 , piece_id=BRRLIWDW4PFYEA6I3JXGXWDVYNXRICVOE7RD6ZWZB6MRBJOTD7CQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.639014572 (502h27m47.101107065s) [noise=true , address=45.91.116.4:4939 , piece_id=ZNSLVMHPEVTRY4ZKHVIVWNON3SONWQ6F7FZ3ZT4R7LP2ZYINR2NA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.639050811 (502h27m47.101143304s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Oct 14 11:59:01.639354730 (502h27m47.101447213s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection Oct 14 11:59:01.639369427 (502h27m47.10146191s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639499285 (502h27m47.101591768s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Oct 14 11:59:01.639509033 (502h27m47.101601506s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639578435 (502h27m47.101670928s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Oct 14 11:59:01.639586410 (502h27m47.101678893s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639605637 (502h27m47.10169813s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 14 11:59:01.639700127 (502h27m47.10179261s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 14 11:59:01.639707291 (502h27m47.101799774s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 14 11:59:02.109914220 (502h27m47.572006704s) [upload=442109]: Done uploading segments... Oct 14 11:59:02.109996106 (502h27m47.572088589s) [upload=442109]: Upload finished. err: <nil> Duration: 7.053100611s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 10.46091256s FAIL (2025-10-14 12:00:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 11:58:56.900661948 (502h27m42.362754431s) [upload=442109]: Starting upload Oct 14 11:58:56.900736511 (502h27m42.362828984s) [upload=442109]: Done starting upload Oct 14 11:58:56.900957481 (502h27m42.363049954s) [upload=442109]: Uploading segments... Oct 14 11:58:56.901011053 (502h27m42.363103536s) [upload=442109]: Got next segment. Inline: false Oct 14 11:58:56.901061008 (502h27m42.363153482s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 14 11:58:56.901069745 (502h27m42.363162258s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 14 11:58:57.204051874 (502h27m42.666144378s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Oct 14 11:58:57.204118782 (502h27m42.666211275s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Oct 14 11:58:57.204146634 (502h27m42.666239117s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204166282 (502h27m42.666258755s) [noise=true , address=45.91.116.4:4939 , piece_id=ZNSLVMHPEVTRY4ZKHVIVWNON3SONWQ6F7FZ3ZT4R7LP2ZYINR2NA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204763349 (502h27m42.666855832s) [noise=true , address=45.91.116.9:4262 , piece_id=BRRLIWDW4PFYEA6I3JXGXWDVYNXRICVOE7RD6ZWZB6MRBJOTD7CQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204924586 (502h27m42.667017059s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.205301294 (502h27m42.667393777s) [noise=true , address=45.91.116.5:4298 , piece_id=GXKI4Y57BU3HF5W7BL7MCDSEKIRFZH7QGYTXOJPZTKEH5AYYA4MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.205679944 (502h27m42.667772427s) [noise=true , address=145.79.227.4:4186 , piece_id=RYLIEI3SPEKF7WGP5ZR3WSVHJ7XMCB6QOGORM5UCO6DDKBVPUA7Q, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206122256 (502h27m42.668214729s) [noise=true , address=145.79.227.3:4151 , piece_id=4MI3TGFP2YODG437SEQO3OUC4AWIIMFFJWKLHLBSO6IOOIJXEVJA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206193091 (502h27m42.668285574s) [noise=true , address=145.79.227.11:4730 , piece_id=5BWLW7QCCA7RZIKLUADIJMUKBV66K3V3GHY2M5AVSL5BV6JYVTJA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206543268 (502h27m42.668635751s) [noise=true , address=145.79.227.11:4731 , piece_id=HIQL5Z43ORQ5JGFHBH7Y5M3MSMTBQ75435FCVEFPCHPR77QC6YZQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206593504 (502h27m42.668685987s) [noise=true , address=77.90.31.11:4553 , piece_id=FDRYYKRC7T35MV5GVNITLUK7RAQM6JK7P2UHN6JAYP4TLPUDMUFA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206929193 (502h27m42.669021676s) [noise=true , address=145.79.227.16:4912 , piece_id=Z4SA2D3PBZIXHR64UJO7S65F7LF3TWMSYEXPJ5P5PFXQYL47ZMDA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207018313 (502h27m42.669110796s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207303506 (502h27m42.669395979s) [noise=true , address=77.90.31.15:4697 , piece_id=ENLPKMJUMTZBA2HU6MFI7MS6I6J2CFN5MDHW3AENGO3N65ED5ZNQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207580313 (502h27m42.669672796s) [noise=true , address=145.79.227.15:4874 , piece_id=VWU5L73HQZXWKXFOKYVFCY5Y5DRD76YYNM72VWSGBT5LUQJTMZ6A, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207663471 (502h27m42.669755954s) [noise=true , address=145.79.227.18:4007 , piece_id=Q5YBDDBEPAZVCIR7H767D7G375KHWNEQN2YK7CWMLD4MDG5BSZTA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.208090354 (502h27m42.670182837s) [noise=true , address=145.79.227.2:4114 , piece_id=SI3A5IMZC656H37RPWL7FZR3NL43OIIS5FVPGJDDBOY6XLC5RBTQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:58.867835816 (502h27m44.329928309s) [upload=442109]: Next returned nil segment Oct 14 11:58:58.867863900 (502h27m44.329956383s) [upload=442109]: Waiting for error group managing segments... Oct 14 11:58:59.140114690 (502h27m44.602207173s) [noise=true , address=145.79.227.3:4151 , piece_id=4MI3TGFP2YODG437SEQO3OUC4AWIIMFFJWKLHLBSO6IOOIJXEVJA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.142057810 (502h27m44.604150293s) [noise=true , address=145.79.227.11:4730 , piece_id=5BWLW7QCCA7RZIKLUADIJMUKBV66K3V3GHY2M5AVSL5BV6JYVTJA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.142291204 (502h27m44.604383677s) [noise=true , address=145.79.227.18:4007 , piece_id=Q5YBDDBEPAZVCIR7H767D7G375KHWNEQN2YK7CWMLD4MDG5BSZTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.145197940 (502h27m44.607290423s) [noise=true , address=145.79.227.2:4114 , piece_id=SI3A5IMZC656H37RPWL7FZR3NL43OIIS5FVPGJDDBOY6XLC5RBTQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.145240631 (502h27m44.607333114s) [noise=true , address=145.79.227.16:4912 , piece_id=Z4SA2D3PBZIXHR64UJO7S65F7LF3TWMSYEXPJ5P5PFXQYL47ZMDA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.147505103 (502h27m44.609597576s) [noise=true , address=145.79.227.11:4731 , piece_id=HIQL5Z43ORQ5JGFHBH7Y5M3MSMTBQ75435FCVEFPCHPR77QC6YZQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.147661310 (502h27m44.609753783s) [noise=true , address=145.79.227.15:4874 , piece_id=VWU5L73HQZXWKXFOKYVFCY5Y5DRD76YYNM72VWSGBT5LUQJTMZ6A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.205186871 (502h27m44.667279354s) [noise=true , address=145.79.227.4:4186 , piece_id=RYLIEI3SPEKF7WGP5ZR3WSVHJ7XMCB6QOGORM5UCO6DDKBVPUA7Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.409850571 (502h27m44.871943044s) [noise=true , address=77.90.31.15:4697 , piece_id=ENLPKMJUMTZBA2HU6MFI7MS6I6J2CFN5MDHW3AENGO3N65ED5ZNQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.513777600 (502h27m44.975870083s) [noise=true , address=77.90.31.11:4553 , piece_id=FDRYYKRC7T35MV5GVNITLUK7RAQM6JK7P2UHN6JAYP4TLPUDMUFA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.432518552 (502h27m46.894611035s) [noise=true , address=45.91.116.5:4298 , piece_id=GXKI4Y57BU3HF5W7BL7MCDSEKIRFZH7QGYTXOJPZTKEH5AYYA4MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.522324560 (502h27m46.984417044s) [noise=true , address=45.91.116.9:4262 , piece_id=BRRLIWDW4PFYEA6I3JXGXWDVYNXRICVOE7RD6ZWZB6MRBJOTD7CQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.639014572 (502h27m47.101107065s) [noise=true , address=45.91.116.4:4939 , piece_id=ZNSLVMHPEVTRY4ZKHVIVWNON3SONWQ6F7FZ3ZT4R7LP2ZYINR2NA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.639050811 (502h27m47.101143304s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Oct 14 11:59:01.639354730 (502h27m47.101447213s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection Oct 14 11:59:01.639369427 (502h27m47.10146191s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639499285 (502h27m47.101591768s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Oct 14 11:59:01.639509033 (502h27m47.101601506s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639578435 (502h27m47.101670928s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Oct 14 11:59:01.639586410 (502h27m47.101678893s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639605637 (502h27m47.10169813s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 14 11:59:01.639700127 (502h27m47.10179261s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 14 11:59:01.639707291 (502h27m47.101799774s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 14 11:59:02.109914220 (502h27m47.572006704s) [upload=442109]: Done uploading segments... Oct 14 11:59:02.109996106 (502h27m47.572088589s) [upload=442109]: Upload finished. err: <nil> Duration: 10.460947338s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 7.63722339s FAIL (2025-10-14 11:59:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 11:58:56.900661948 (502h27m42.362754431s) [upload=442109]: Starting upload Oct 14 11:58:56.900736511 (502h27m42.362828984s) [upload=442109]: Done starting upload Oct 14 11:58:56.900957481 (502h27m42.363049954s) [upload=442109]: Uploading segments... Oct 14 11:58:56.901011053 (502h27m42.363103536s) [upload=442109]: Got next segment. Inline: false Oct 14 11:58:56.901061008 (502h27m42.363153482s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 14 11:58:56.901069745 (502h27m42.363162258s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 14 11:58:57.204051874 (502h27m42.666144378s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Oct 14 11:58:57.204118782 (502h27m42.666211275s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Oct 14 11:58:57.204146634 (502h27m42.666239117s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204166282 (502h27m42.666258755s) [noise=true , address=45.91.116.4:4939 , piece_id=ZNSLVMHPEVTRY4ZKHVIVWNON3SONWQ6F7FZ3ZT4R7LP2ZYINR2NA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204763349 (502h27m42.666855832s) [noise=true , address=45.91.116.9:4262 , piece_id=BRRLIWDW4PFYEA6I3JXGXWDVYNXRICVOE7RD6ZWZB6MRBJOTD7CQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204924586 (502h27m42.667017059s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.205301294 (502h27m42.667393777s) [noise=true , address=45.91.116.5:4298 , piece_id=GXKI4Y57BU3HF5W7BL7MCDSEKIRFZH7QGYTXOJPZTKEH5AYYA4MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.205679944 (502h27m42.667772427s) [noise=true , address=145.79.227.4:4186 , piece_id=RYLIEI3SPEKF7WGP5ZR3WSVHJ7XMCB6QOGORM5UCO6DDKBVPUA7Q, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206122256 (502h27m42.668214729s) [noise=true , address=145.79.227.3:4151 , piece_id=4MI3TGFP2YODG437SEQO3OUC4AWIIMFFJWKLHLBSO6IOOIJXEVJA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206193091 (502h27m42.668285574s) [noise=true , address=145.79.227.11:4730 , piece_id=5BWLW7QCCA7RZIKLUADIJMUKBV66K3V3GHY2M5AVSL5BV6JYVTJA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206543268 (502h27m42.668635751s) [noise=true , address=145.79.227.11:4731 , piece_id=HIQL5Z43ORQ5JGFHBH7Y5M3MSMTBQ75435FCVEFPCHPR77QC6YZQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206593504 (502h27m42.668685987s) [noise=true , address=77.90.31.11:4553 , piece_id=FDRYYKRC7T35MV5GVNITLUK7RAQM6JK7P2UHN6JAYP4TLPUDMUFA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206929193 (502h27m42.669021676s) [noise=true , address=145.79.227.16:4912 , piece_id=Z4SA2D3PBZIXHR64UJO7S65F7LF3TWMSYEXPJ5P5PFXQYL47ZMDA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207018313 (502h27m42.669110796s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207303506 (502h27m42.669395979s) [noise=true , address=77.90.31.15:4697 , piece_id=ENLPKMJUMTZBA2HU6MFI7MS6I6J2CFN5MDHW3AENGO3N65ED5ZNQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207580313 (502h27m42.669672796s) [noise=true , address=145.79.227.15:4874 , piece_id=VWU5L73HQZXWKXFOKYVFCY5Y5DRD76YYNM72VWSGBT5LUQJTMZ6A, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207663471 (502h27m42.669755954s) [noise=true , address=145.79.227.18:4007 , piece_id=Q5YBDDBEPAZVCIR7H767D7G375KHWNEQN2YK7CWMLD4MDG5BSZTA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.208090354 (502h27m42.670182837s) [noise=true , address=145.79.227.2:4114 , piece_id=SI3A5IMZC656H37RPWL7FZR3NL43OIIS5FVPGJDDBOY6XLC5RBTQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:58.867835816 (502h27m44.329928309s) [upload=442109]: Next returned nil segment Oct 14 11:58:58.867863900 (502h27m44.329956383s) [upload=442109]: Waiting for error group managing segments... Oct 14 11:58:59.140114690 (502h27m44.602207173s) [noise=true , address=145.79.227.3:4151 , piece_id=4MI3TGFP2YODG437SEQO3OUC4AWIIMFFJWKLHLBSO6IOOIJXEVJA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.142057810 (502h27m44.604150293s) [noise=true , address=145.79.227.11:4730 , piece_id=5BWLW7QCCA7RZIKLUADIJMUKBV66K3V3GHY2M5AVSL5BV6JYVTJA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.142291204 (502h27m44.604383677s) [noise=true , address=145.79.227.18:4007 , piece_id=Q5YBDDBEPAZVCIR7H767D7G375KHWNEQN2YK7CWMLD4MDG5BSZTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.145197940 (502h27m44.607290423s) [noise=true , address=145.79.227.2:4114 , piece_id=SI3A5IMZC656H37RPWL7FZR3NL43OIIS5FVPGJDDBOY6XLC5RBTQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.145240631 (502h27m44.607333114s) [noise=true , address=145.79.227.16:4912 , piece_id=Z4SA2D3PBZIXHR64UJO7S65F7LF3TWMSYEXPJ5P5PFXQYL47ZMDA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.147505103 (502h27m44.609597576s) [noise=true , address=145.79.227.11:4731 , piece_id=HIQL5Z43ORQ5JGFHBH7Y5M3MSMTBQ75435FCVEFPCHPR77QC6YZQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.147661310 (502h27m44.609753783s) [noise=true , address=145.79.227.15:4874 , piece_id=VWU5L73HQZXWKXFOKYVFCY5Y5DRD76YYNM72VWSGBT5LUQJTMZ6A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.205186871 (502h27m44.667279354s) [noise=true , address=145.79.227.4:4186 , piece_id=RYLIEI3SPEKF7WGP5ZR3WSVHJ7XMCB6QOGORM5UCO6DDKBVPUA7Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.409850571 (502h27m44.871943044s) [noise=true , address=77.90.31.15:4697 , piece_id=ENLPKMJUMTZBA2HU6MFI7MS6I6J2CFN5MDHW3AENGO3N65ED5ZNQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.513777600 (502h27m44.975870083s) [noise=true , address=77.90.31.11:4553 , piece_id=FDRYYKRC7T35MV5GVNITLUK7RAQM6JK7P2UHN6JAYP4TLPUDMUFA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.432518552 (502h27m46.894611035s) [noise=true , address=45.91.116.5:4298 , piece_id=GXKI4Y57BU3HF5W7BL7MCDSEKIRFZH7QGYTXOJPZTKEH5AYYA4MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.522324560 (502h27m46.984417044s) [noise=true , address=45.91.116.9:4262 , piece_id=BRRLIWDW4PFYEA6I3JXGXWDVYNXRICVOE7RD6ZWZB6MRBJOTD7CQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.639014572 (502h27m47.101107065s) [noise=true , address=45.91.116.4:4939 , piece_id=ZNSLVMHPEVTRY4ZKHVIVWNON3SONWQ6F7FZ3ZT4R7LP2ZYINR2NA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.639050811 (502h27m47.101143304s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Oct 14 11:59:01.639354730 (502h27m47.101447213s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection Oct 14 11:59:01.639369427 (502h27m47.10146191s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639499285 (502h27m47.101591768s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Oct 14 11:59:01.639509033 (502h27m47.101601506s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639578435 (502h27m47.101670928s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Oct 14 11:59:01.639586410 (502h27m47.101678893s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639605637 (502h27m47.10169813s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 14 11:59:01.639700127 (502h27m47.10179261s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 14 11:59:01.639707291 (502h27m47.101799774s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 14 11:59:02.109914220 (502h27m47.572006704s) [upload=442109]: Done uploading segments... Oct 14 11:59:02.109996106 (502h27m47.572088589s) [upload=442109]: Upload finished. err: <nil> Duration: 7.637251353s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002591217s FAIL (2025-10-14 11:59:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 11:58:56.900661948 (502h27m42.362754431s) [upload=442109]: Starting upload Oct 14 11:58:56.900736511 (502h27m42.362828984s) [upload=442109]: Done starting upload Oct 14 11:58:56.900957481 (502h27m42.363049954s) [upload=442109]: Uploading segments... Oct 14 11:58:56.901011053 (502h27m42.363103536s) [upload=442109]: Got next segment. Inline: false Oct 14 11:58:56.901061008 (502h27m42.363153482s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 14 11:58:56.901069745 (502h27m42.363162258s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 14 11:58:57.204051874 (502h27m42.666144378s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Oct 14 11:58:57.204118782 (502h27m42.666211275s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Oct 14 11:58:57.204146634 (502h27m42.666239117s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204166282 (502h27m42.666258755s) [noise=true , address=45.91.116.4:4939 , piece_id=ZNSLVMHPEVTRY4ZKHVIVWNON3SONWQ6F7FZ3ZT4R7LP2ZYINR2NA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204763349 (502h27m42.666855832s) [noise=true , address=45.91.116.9:4262 , piece_id=BRRLIWDW4PFYEA6I3JXGXWDVYNXRICVOE7RD6ZWZB6MRBJOTD7CQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.204924586 (502h27m42.667017059s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.205301294 (502h27m42.667393777s) [noise=true , address=45.91.116.5:4298 , piece_id=GXKI4Y57BU3HF5W7BL7MCDSEKIRFZH7QGYTXOJPZTKEH5AYYA4MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.205679944 (502h27m42.667772427s) [noise=true , address=145.79.227.4:4186 , piece_id=RYLIEI3SPEKF7WGP5ZR3WSVHJ7XMCB6QOGORM5UCO6DDKBVPUA7Q, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206122256 (502h27m42.668214729s) [noise=true , address=145.79.227.3:4151 , piece_id=4MI3TGFP2YODG437SEQO3OUC4AWIIMFFJWKLHLBSO6IOOIJXEVJA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206193091 (502h27m42.668285574s) [noise=true , address=145.79.227.11:4730 , piece_id=5BWLW7QCCA7RZIKLUADIJMUKBV66K3V3GHY2M5AVSL5BV6JYVTJA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206543268 (502h27m42.668635751s) [noise=true , address=145.79.227.11:4731 , piece_id=HIQL5Z43ORQ5JGFHBH7Y5M3MSMTBQ75435FCVEFPCHPR77QC6YZQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206593504 (502h27m42.668685987s) [noise=true , address=77.90.31.11:4553 , piece_id=FDRYYKRC7T35MV5GVNITLUK7RAQM6JK7P2UHN6JAYP4TLPUDMUFA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.206929193 (502h27m42.669021676s) [noise=true , address=145.79.227.16:4912 , piece_id=Z4SA2D3PBZIXHR64UJO7S65F7LF3TWMSYEXPJ5P5PFXQYL47ZMDA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207018313 (502h27m42.669110796s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207303506 (502h27m42.669395979s) [noise=true , address=77.90.31.15:4697 , piece_id=ENLPKMJUMTZBA2HU6MFI7MS6I6J2CFN5MDHW3AENGO3N65ED5ZNQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207580313 (502h27m42.669672796s) [noise=true , address=145.79.227.15:4874 , piece_id=VWU5L73HQZXWKXFOKYVFCY5Y5DRD76YYNM72VWSGBT5LUQJTMZ6A, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.207663471 (502h27m42.669755954s) [noise=true , address=145.79.227.18:4007 , piece_id=Q5YBDDBEPAZVCIR7H767D7G375KHWNEQN2YK7CWMLD4MDG5BSZTA, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:57.208090354 (502h27m42.670182837s) [noise=true , address=145.79.227.2:4114 , piece_id=SI3A5IMZC656H37RPWL7FZR3NL43OIIS5FVPGJDDBOY6XLC5RBTQ, seg_pos={0 0}, upload=442109]: Uploading piece... Oct 14 11:58:58.867835816 (502h27m44.329928309s) [upload=442109]: Next returned nil segment Oct 14 11:58:58.867863900 (502h27m44.329956383s) [upload=442109]: Waiting for error group managing segments... Oct 14 11:58:59.140114690 (502h27m44.602207173s) [noise=true , address=145.79.227.3:4151 , piece_id=4MI3TGFP2YODG437SEQO3OUC4AWIIMFFJWKLHLBSO6IOOIJXEVJA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.142057810 (502h27m44.604150293s) [noise=true , address=145.79.227.11:4730 , piece_id=5BWLW7QCCA7RZIKLUADIJMUKBV66K3V3GHY2M5AVSL5BV6JYVTJA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.142291204 (502h27m44.604383677s) [noise=true , address=145.79.227.18:4007 , piece_id=Q5YBDDBEPAZVCIR7H767D7G375KHWNEQN2YK7CWMLD4MDG5BSZTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.145197940 (502h27m44.607290423s) [noise=true , address=145.79.227.2:4114 , piece_id=SI3A5IMZC656H37RPWL7FZR3NL43OIIS5FVPGJDDBOY6XLC5RBTQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.145240631 (502h27m44.607333114s) [noise=true , address=145.79.227.16:4912 , piece_id=Z4SA2D3PBZIXHR64UJO7S65F7LF3TWMSYEXPJ5P5PFXQYL47ZMDA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.147505103 (502h27m44.609597576s) [noise=true , address=145.79.227.11:4731 , piece_id=HIQL5Z43ORQ5JGFHBH7Y5M3MSMTBQ75435FCVEFPCHPR77QC6YZQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.147661310 (502h27m44.609753783s) [noise=true , address=145.79.227.15:4874 , piece_id=VWU5L73HQZXWKXFOKYVFCY5Y5DRD76YYNM72VWSGBT5LUQJTMZ6A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.205186871 (502h27m44.667279354s) [noise=true , address=145.79.227.4:4186 , piece_id=RYLIEI3SPEKF7WGP5ZR3WSVHJ7XMCB6QOGORM5UCO6DDKBVPUA7Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.409850571 (502h27m44.871943044s) [noise=true , address=77.90.31.15:4697 , piece_id=ENLPKMJUMTZBA2HU6MFI7MS6I6J2CFN5MDHW3AENGO3N65ED5ZNQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:58:59.513777600 (502h27m44.975870083s) [noise=true , address=77.90.31.11:4553 , piece_id=FDRYYKRC7T35MV5GVNITLUK7RAQM6JK7P2UHN6JAYP4TLPUDMUFA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.432518552 (502h27m46.894611035s) [noise=true , address=45.91.116.5:4298 , piece_id=GXKI4Y57BU3HF5W7BL7MCDSEKIRFZH7QGYTXOJPZTKEH5AYYA4MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.522324560 (502h27m46.984417044s) [noise=true , address=45.91.116.9:4262 , piece_id=BRRLIWDW4PFYEA6I3JXGXWDVYNXRICVOE7RD6ZWZB6MRBJOTD7CQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.639014572 (502h27m47.101107065s) [noise=true , address=45.91.116.4:4939 , piece_id=ZNSLVMHPEVTRY4ZKHVIVWNON3SONWQ6F7FZ3ZT4R7LP2ZYINR2NA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Oct 14 11:59:01.639050811 (502h27m47.101143304s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Oct 14 11:59:01.639354730 (502h27m47.101447213s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->45.91.116.11:4118: use of closed network connection Oct 14 11:59:01.639369427 (502h27m47.10146191s) [noise=true , address=45.91.116.11:4118 , piece_id=TTWDGGIIYBV3XNNA5D5VUAV6QGNVOMWRNJWDVYTFPK5TWPDPKQPA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639499285 (502h27m47.101591768s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Oct 14 11:59:01.639509033 (502h27m47.101601506s) [noise=true , address=45.91.116.7:4010 , piece_id=FF4WHSEEQ2XK2ZZJO32K5BCC6S2OFAX3Q7DSP5NZV3P2ZKJGR6CA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639578435 (502h27m47.101670928s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF Oct 14 11:59:01.639586410 (502h27m47.101678893s) [noise=true , address=45.91.116.6:4975 , piece_id=THUXE7YEYWHYZ35NEUNCOPNGJARCI6NC5QBNCCP4UHIZDRX6YXOA, seg_pos={0 0}, upload=442109]: Long tail cancellation due to optimal threshold Oct 14 11:59:01.639605637 (502h27m47.10169813s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 14 11:59:01.639700127 (502h27m47.10179261s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 14 11:59:01.639707291 (502h27m47.101799774s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 14 11:59:02.109914220 (502h27m47.572006704s) [upload=442109]: Done uploading segments... Oct 14 11:59:02.109996106 (502h27m47.572088589s) [upload=442109]: Upload finished. err: <nil> Duration: 30.002617447s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.449348235s FAIL (2025-10-14 09:23:08 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.449381319s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.153880057s FAIL (2025-10-14 09:22:04 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.153912507s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.14575131s FAIL (2025-10-14 09:21:46 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.145779825s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.267042481s FAIL (2025-10-14 09:21:00 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.267070976s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.453669993s FAIL (2025-10-14 09:19:56 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.453699219s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.590508969s FAIL (2025-10-14 09:18:48 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.590539178s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.204961997s FAIL (2025-10-14 09:18:25 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.204999408s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.119702076s FAIL (2025-10-14 09:18:01 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.119728055s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.352924089s FAIL (2025-10-14 09:17:18 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.353117277s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.458597656s FAIL (2025-10-14 09:16:55 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.458624396s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.328359199s FAIL (2025-10-14 09:16:18 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.328375961s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.382196266s FAIL (2025-10-14 09:16:01 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.382226865s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.275743782s FAIL (2025-10-14 09:14:56 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.27581076s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.372395805s FAIL (2025-10-14 09:13:48 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.372427796s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.548703894s FAIL (2025-10-14 09:13:24 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.548737378s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.234485508s FAIL (2025-10-14 09:12:22 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.234516869s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.411476209s FAIL (2025-10-14 09:11:15 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.411502188s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.209105558s FAIL (2025-10-14 09:10:37 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.209140124s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.309174104s FAIL (2025-10-14 09:09:39 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.309202208s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.25013112s FAIL (2025-10-14 09:08:33 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.250160114s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.456975993s FAIL (2025-10-14 09:07:28 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.457003826s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.389346474s FAIL (2025-10-14 09:06:14 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.389375518s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.412762877s FAIL (2025-10-14 09:05:18 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.412790499s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.281879947s FAIL (2025-10-14 09:04:10 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.28190765s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.391704033s FAIL (2025-10-14 09:03:03 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.391731434s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.228767016s FAIL (2025-10-14 09:01:54 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.228793496s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.431114788s FAIL (2025-10-14 09:01:17 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.431143361s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.483714557s FAIL (2025-10-14 09:00:49 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.483742559s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.495631467s FAIL (2025-10-14 08:59:39 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.495652066s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.085721334s FAIL (2025-10-14 08:58:57 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.085754687s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.109731162s FAIL (2025-10-14 08:58:38 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.10976131s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.339400275s FAIL (2025-10-14 08:58:06 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.339448908s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.209812665s FAIL (2025-10-14 08:57:46 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.209844907s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.298661891s FAIL (2025-10-14 08:56:47 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.298696638s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.184426958s FAIL (2025-10-14 08:55:53 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.184461023s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.290381324s FAIL (2025-10-14 08:55:16 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.290406842s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.348382246s FAIL (2025-10-14 08:54:27 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.348407125s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.453255124s FAIL (2025-10-14 08:53:13 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.453281263s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.417205332s FAIL (2025-10-14 08:52:44 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.417229879s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.319030054s FAIL (2025-10-14 08:52:23 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.319098314s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.284759459s FAIL (2025-10-14 08:51:38 UTC) orbiter warning: read tcp 188.166.225.170:59824->45.38.24.2:443: read: connection reset by peer Duration: 6.284788425s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)