Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
10.155018936s
FAIL (2025-10-06 13:16:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, Piece ID: WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA) context deadline exceeded; piecestore: (Node ID: 1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, Piece ID: Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ) context deadline exceeded
======LOGS======
Oct 6 13:13:24.290217017 (311h42m9.75230951s) [upload=274317]: Starting upload
Oct 6 13:13:24.290293252 (311h42m9.752385765s) [upload=274317]: Done starting upload
Oct 6 13:13:24.290414243 (311h42m9.752506756s) [upload=274317]: Uploading segments...
Oct 6 13:13:24.290520916 (311h42m9.752613409s) [upload=274317]: Got next segment. Inline: false
Oct 6 13:13:24.290574678 (311h42m9.752667171s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 13:13:24.290581321 (311h42m9.752673804s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 13:13:28.554542526 (311h42m14.016635039s) [seg_pos={0 0}, upload=274317]: Begin upload segment...
Oct 6 13:13:28.554617589 (311h42m14.016710072s) [seg_pos={0 0}, upload=274317]: Done begin upload segment.
Oct 6 13:13:28.554651724 (311h42m14.016744207s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554668486 (311h42m14.016760969s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554761533 (311h42m14.016854016s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555361265 (311h42m14.017453748s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555518985 (311h42m14.017611468s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555851118 (311h42m14.017943601s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555881716 (311h42m14.017974199s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556231412 (311h42m14.018323885s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556296797 (311h42m14.01838928s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556581228 (311h42m14.018673711s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556884205 (311h42m14.018976688s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557064488 (311h42m14.019156971s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557329584 (311h42m14.019422067s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557432328 (311h42m14.019524811s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557763880 (311h42m14.019856363s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.558255436 (311h42m14.020347929s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:30.250161729 (311h42m15.712254202s) [upload=274317]: Next returned nil segment
Oct 6 13:13:30.250195252 (311h42m15.712287725s) [upload=274317]: Waiting for error group managing segments...
Oct 6 13:13:30.536699728 (311h42m15.998792201s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.553349142 (311h42m16.015441625s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.578897330 (311h42m16.040989813s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.762266779 (311h42m16.224359262s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.772294724 (311h42m16.234387197s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.781131200 (311h42m16.243223673s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.789903855 (311h42m16.251996328s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802311901 (311h42m16.264404384s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802673110 (311h42m16.264765593s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.815840212 (311h42m16.277932695s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.817508859 (311h42m16.279601342s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.818567455 (311h42m16.280659938s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826324886 (311h42m16.28841742s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826417373 (311h42m16.288509856s) [seg_pos={0 0}, upload=274317]: Segment reached optimal threshold of 13 pieces.
Oct 6 13:13:30.826578349 (311h42m16.288670842s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826588419 (311h42m16.288680902s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826682497 (311h42m16.28877498s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826704900 (311h42m16.288797383s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826718586 (311h42m16.288811069s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826733735 (311h42m16.288826208s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826772569 (311h42m16.288865052s) [seg_pos={0 0}, upload=274317]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 13:13:30.826865376 (311h42m16.288957909s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 13:13:30.826872319 (311h42m16.288964802s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 13:13:39.169097752 (311h42m24.631190225s) [upload=274317]: Done uploading segments...
Oct 6 13:13:39.169116778 (311h42m24.631209251s) [upload=274317]: Upload finished. err: <nil>
Duration: 10.15504713s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.461514472s
FAIL (2025-10-06 13:15:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, Piece ID: WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA) context deadline exceeded; piecestore: (Node ID: 1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, Piece ID: Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ) context deadline exceeded
======LOGS======
Oct 6 13:13:24.290217017 (311h42m9.75230951s) [upload=274317]: Starting upload
Oct 6 13:13:24.290293252 (311h42m9.752385765s) [upload=274317]: Done starting upload
Oct 6 13:13:24.290414243 (311h42m9.752506756s) [upload=274317]: Uploading segments...
Oct 6 13:13:24.290520916 (311h42m9.752613409s) [upload=274317]: Got next segment. Inline: false
Oct 6 13:13:24.290574678 (311h42m9.752667171s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 13:13:24.290581321 (311h42m9.752673804s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 13:13:28.554542526 (311h42m14.016635039s) [seg_pos={0 0}, upload=274317]: Begin upload segment...
Oct 6 13:13:28.554617589 (311h42m14.016710072s) [seg_pos={0 0}, upload=274317]: Done begin upload segment.
Oct 6 13:13:28.554651724 (311h42m14.016744207s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554668486 (311h42m14.016760969s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554761533 (311h42m14.016854016s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555361265 (311h42m14.017453748s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555518985 (311h42m14.017611468s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555851118 (311h42m14.017943601s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555881716 (311h42m14.017974199s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556231412 (311h42m14.018323885s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556296797 (311h42m14.01838928s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556581228 (311h42m14.018673711s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556884205 (311h42m14.018976688s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557064488 (311h42m14.019156971s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557329584 (311h42m14.019422067s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557432328 (311h42m14.019524811s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557763880 (311h42m14.019856363s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.558255436 (311h42m14.020347929s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:30.250161729 (311h42m15.712254202s) [upload=274317]: Next returned nil segment
Oct 6 13:13:30.250195252 (311h42m15.712287725s) [upload=274317]: Waiting for error group managing segments...
Oct 6 13:13:30.536699728 (311h42m15.998792201s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.553349142 (311h42m16.015441625s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.578897330 (311h42m16.040989813s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.762266779 (311h42m16.224359262s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.772294724 (311h42m16.234387197s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.781131200 (311h42m16.243223673s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.789903855 (311h42m16.251996328s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802311901 (311h42m16.264404384s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802673110 (311h42m16.264765593s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.815840212 (311h42m16.277932695s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.817508859 (311h42m16.279601342s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.818567455 (311h42m16.280659938s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826324886 (311h42m16.28841742s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826417373 (311h42m16.288509856s) [seg_pos={0 0}, upload=274317]: Segment reached optimal threshold of 13 pieces.
Oct 6 13:13:30.826578349 (311h42m16.288670842s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826588419 (311h42m16.288680902s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826682497 (311h42m16.28877498s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826704900 (311h42m16.288797383s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826718586 (311h42m16.288811069s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826733735 (311h42m16.288826208s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826772569 (311h42m16.288865052s) [seg_pos={0 0}, upload=274317]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 13:13:30.826865376 (311h42m16.288957909s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 13:13:30.826872319 (311h42m16.288964802s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 13:13:39.169097752 (311h42m24.631190225s) [upload=274317]: Done uploading segments...
Oct 6 13:13:39.169116778 (311h42m24.631209251s) [upload=274317]: Upload finished. err: <nil>
Duration: 6.461544909s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
6.488837399s
FAIL (2025-10-06 13:14:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, Piece ID: WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA) context deadline exceeded; piecestore: (Node ID: 1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, Piece ID: Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ) context deadline exceeded
======LOGS======
Oct 6 13:13:24.290217017 (311h42m9.75230951s) [upload=274317]: Starting upload
Oct 6 13:13:24.290293252 (311h42m9.752385765s) [upload=274317]: Done starting upload
Oct 6 13:13:24.290414243 (311h42m9.752506756s) [upload=274317]: Uploading segments...
Oct 6 13:13:24.290520916 (311h42m9.752613409s) [upload=274317]: Got next segment. Inline: false
Oct 6 13:13:24.290574678 (311h42m9.752667171s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 13:13:24.290581321 (311h42m9.752673804s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 13:13:28.554542526 (311h42m14.016635039s) [seg_pos={0 0}, upload=274317]: Begin upload segment...
Oct 6 13:13:28.554617589 (311h42m14.016710072s) [seg_pos={0 0}, upload=274317]: Done begin upload segment.
Oct 6 13:13:28.554651724 (311h42m14.016744207s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554668486 (311h42m14.016760969s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554761533 (311h42m14.016854016s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555361265 (311h42m14.017453748s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555518985 (311h42m14.017611468s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555851118 (311h42m14.017943601s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555881716 (311h42m14.017974199s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556231412 (311h42m14.018323885s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556296797 (311h42m14.01838928s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556581228 (311h42m14.018673711s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556884205 (311h42m14.018976688s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557064488 (311h42m14.019156971s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557329584 (311h42m14.019422067s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557432328 (311h42m14.019524811s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557763880 (311h42m14.019856363s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.558255436 (311h42m14.020347929s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:30.250161729 (311h42m15.712254202s) [upload=274317]: Next returned nil segment
Oct 6 13:13:30.250195252 (311h42m15.712287725s) [upload=274317]: Waiting for error group managing segments...
Oct 6 13:13:30.536699728 (311h42m15.998792201s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.553349142 (311h42m16.015441625s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.578897330 (311h42m16.040989813s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.762266779 (311h42m16.224359262s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.772294724 (311h42m16.234387197s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.781131200 (311h42m16.243223673s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.789903855 (311h42m16.251996328s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802311901 (311h42m16.264404384s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802673110 (311h42m16.264765593s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.815840212 (311h42m16.277932695s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.817508859 (311h42m16.279601342s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.818567455 (311h42m16.280659938s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826324886 (311h42m16.28841742s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826417373 (311h42m16.288509856s) [seg_pos={0 0}, upload=274317]: Segment reached optimal threshold of 13 pieces.
Oct 6 13:13:30.826578349 (311h42m16.288670842s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826588419 (311h42m16.288680902s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826682497 (311h42m16.28877498s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826704900 (311h42m16.288797383s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826718586 (311h42m16.288811069s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826733735 (311h42m16.288826208s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826772569 (311h42m16.288865052s) [seg_pos={0 0}, upload=274317]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 13:13:30.826865376 (311h42m16.288957909s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 13:13:30.826872319 (311h42m16.288964802s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 13:13:39.169097752 (311h42m24.631190225s) [upload=274317]: Done uploading segments...
Oct 6 13:13:39.169116778 (311h42m24.631209251s) [upload=274317]: Upload finished. err: <nil>
Duration: 6.488880972s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
22.45426568s
FAIL (2025-10-06 13:14:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, Piece ID: WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA) context deadline exceeded; piecestore: (Node ID: 1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, Piece ID: Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ) context deadline exceeded
======LOGS======
Oct 6 13:13:24.290217017 (311h42m9.75230951s) [upload=274317]: Starting upload
Oct 6 13:13:24.290293252 (311h42m9.752385765s) [upload=274317]: Done starting upload
Oct 6 13:13:24.290414243 (311h42m9.752506756s) [upload=274317]: Uploading segments...
Oct 6 13:13:24.290520916 (311h42m9.752613409s) [upload=274317]: Got next segment. Inline: false
Oct 6 13:13:24.290574678 (311h42m9.752667171s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 13:13:24.290581321 (311h42m9.752673804s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 13:13:28.554542526 (311h42m14.016635039s) [seg_pos={0 0}, upload=274317]: Begin upload segment...
Oct 6 13:13:28.554617589 (311h42m14.016710072s) [seg_pos={0 0}, upload=274317]: Done begin upload segment.
Oct 6 13:13:28.554651724 (311h42m14.016744207s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554668486 (311h42m14.016760969s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554761533 (311h42m14.016854016s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555361265 (311h42m14.017453748s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555518985 (311h42m14.017611468s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555851118 (311h42m14.017943601s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555881716 (311h42m14.017974199s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556231412 (311h42m14.018323885s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556296797 (311h42m14.01838928s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556581228 (311h42m14.018673711s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556884205 (311h42m14.018976688s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557064488 (311h42m14.019156971s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557329584 (311h42m14.019422067s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557432328 (311h42m14.019524811s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557763880 (311h42m14.019856363s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.558255436 (311h42m14.020347929s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:30.250161729 (311h42m15.712254202s) [upload=274317]: Next returned nil segment
Oct 6 13:13:30.250195252 (311h42m15.712287725s) [upload=274317]: Waiting for error group managing segments...
Oct 6 13:13:30.536699728 (311h42m15.998792201s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.553349142 (311h42m16.015441625s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.578897330 (311h42m16.040989813s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.762266779 (311h42m16.224359262s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.772294724 (311h42m16.234387197s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.781131200 (311h42m16.243223673s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.789903855 (311h42m16.251996328s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802311901 (311h42m16.264404384s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802673110 (311h42m16.264765593s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.815840212 (311h42m16.277932695s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.817508859 (311h42m16.279601342s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.818567455 (311h42m16.280659938s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826324886 (311h42m16.28841742s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826417373 (311h42m16.288509856s) [seg_pos={0 0}, upload=274317]: Segment reached optimal threshold of 13 pieces.
Oct 6 13:13:30.826578349 (311h42m16.288670842s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826588419 (311h42m16.288680902s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826682497 (311h42m16.28877498s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826704900 (311h42m16.288797383s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826718586 (311h42m16.288811069s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826733735 (311h42m16.288826208s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826772569 (311h42m16.288865052s) [seg_pos={0 0}, upload=274317]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 13:13:30.826865376 (311h42m16.288957909s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 13:13:30.826872319 (311h42m16.288964802s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 13:13:39.169097752 (311h42m24.631190225s) [upload=274317]: Done uploading segments...
Oct 6 13:13:39.169116778 (311h42m24.631209251s) [upload=274317]: Upload finished. err: <nil>
Duration: 22.454401748s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.003937306s
FAIL (2025-10-06 13:13:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, Piece ID: WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA) context deadline exceeded; piecestore: (Node ID: 1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, Piece ID: Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ) context deadline exceeded
======LOGS======
Oct 6 13:13:24.290217017 (311h42m9.75230951s) [upload=274317]: Starting upload
Oct 6 13:13:24.290293252 (311h42m9.752385765s) [upload=274317]: Done starting upload
Oct 6 13:13:24.290414243 (311h42m9.752506756s) [upload=274317]: Uploading segments...
Oct 6 13:13:24.290520916 (311h42m9.752613409s) [upload=274317]: Got next segment. Inline: false
Oct 6 13:13:24.290574678 (311h42m9.752667171s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 6 13:13:24.290581321 (311h42m9.752673804s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 6 13:13:28.554542526 (311h42m14.016635039s) [seg_pos={0 0}, upload=274317]: Begin upload segment...
Oct 6 13:13:28.554617589 (311h42m14.016710072s) [seg_pos={0 0}, upload=274317]: Done begin upload segment.
Oct 6 13:13:28.554651724 (311h42m14.016744207s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554668486 (311h42m14.016760969s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.554761533 (311h42m14.016854016s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555361265 (311h42m14.017453748s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555518985 (311h42m14.017611468s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555851118 (311h42m14.017943601s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.555881716 (311h42m14.017974199s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556231412 (311h42m14.018323885s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556296797 (311h42m14.01838928s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556581228 (311h42m14.018673711s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.556884205 (311h42m14.018976688s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557064488 (311h42m14.019156971s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557329584 (311h42m14.019422067s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557432328 (311h42m14.019524811s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.557763880 (311h42m14.019856363s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:28.558255436 (311h42m14.020347929s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Uploading piece...
Oct 6 13:13:30.250161729 (311h42m15.712254202s) [upload=274317]: Next returned nil segment
Oct 6 13:13:30.250195252 (311h42m15.712287725s) [upload=274317]: Waiting for error group managing segments...
Oct 6 13:13:30.536699728 (311h42m15.998792201s) [noise=true , address=145.79.227.5:4223 , piece_id=55RT2A7CPA66RGVXRPNDER52657RDDNMKS74AX2SLE5JSA3IP5TQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.553349142 (311h42m16.015441625s) [noise=true , address=145.79.227.13:4802 , piece_id=YIRGDOTEZSZM3HZZMJ2SW7CPYKYFQFYM3M5BMPRQO4EHAATDQOBQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.578897330 (311h42m16.040989813s) [noise=true , address=145.79.227.13:4801 , piece_id=3UAZFIGEC6LUUKDF4H4BQGNJJMAYYAKKXSDTYP2TWCZ7S5RXRPNQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.762266779 (311h42m16.224359262s) [noise=true , address=45.91.116.8:4047 , piece_id=ERD6QLQTHZYQEZ4KXNPA7VOBJ2IRHPEZXBW3DSPDKOAGYJ6JQJYA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.772294724 (311h42m16.234387197s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3IOQYYUPIN7WBZF5O5QPOHWG3WK25C2MOOXLK6EBIH3OYJ64OMA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.781131200 (311h42m16.243223673s) [noise=true , address=45.91.116.4:4940 , piece_id=XJXCOQRH2P5BRKMCDX42G7UDLCUHPCPZY4B53UZX2Q6CX7J3KW7Q, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.789903855 (311h42m16.251996328s) [noise=true , address=45.91.116.6:4973 , piece_id=KF3TVTYMV6NWAIDLYD5HFUL2CDFDEWDAW7NC5ZH4DBQZ4XI74PWA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802311901 (311h42m16.264404384s) [noise=true , address=77.90.31.11:4553 , piece_id=S3J42GZASR3VSRPRXIKNN7GELSE63SB423GI5BHX6XBOKUEBFVQA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.802673110 (311h42m16.264765593s) [noise=true , address=45.91.116.11:4119 , piece_id=AUWJXB6YHCIMGEMJ6KOQMNENH7HJ3JZLUXIWW76M7OVSABUCTFFA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.815840212 (311h42m16.277932695s) [noise=true , address=45.91.116.9:4263 , piece_id=TLF4526G7ASD5DQETLMDCI2UKHU4W5C277RX42AH3HZOGXHOFWGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.817508859 (311h42m16.279601342s) [noise=true , address=77.90.31.16:4734 , piece_id=Y3XC3HG7WVVGNYXUP4GDJLXIXNVDVWA77J22HRYZS4K5Q67H2VLQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.818567455 (311h42m16.280659938s) [noise=true , address=77.90.31.19:4843 , piece_id=ISMHSV6CLDW3S65HNCY7RVBWVPXSPCGADB43WBPGSDH36Z5KDCGQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826324886 (311h42m16.28841742s) [noise=true , address=45.91.116.10:4081 , piece_id=WTND2JRGKAAZFEPQLSTLLSMYCKCAYNZIYOW5W4VDSBIWRCWXDZGA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: <nil>
Oct 6 13:13:30.826417373 (311h42m16.288509856s) [seg_pos={0 0}, upload=274317]: Segment reached optimal threshold of 13 pieces.
Oct 6 13:13:30.826578349 (311h42m16.288670842s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826588419 (311h42m16.288680902s) [noise=true , address=77.90.31.21:4879 , piece_id=74OWMUD3GWDLUAUO2U45JL46YGZBIDVGEBSANJMIJKKRJZ5BOKAQ, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826682497 (311h42m16.28877498s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826704900 (311h42m16.288797383s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Oct 6 13:13:30.826718586 (311h42m16.288811069s) [noise=true , address=45.91.116.13:4153 , piece_id=F5LMTNAIY2FMOCDNM3ZOERS7PVEA4Z7Q65AGJNQZUINWZDYW6TCA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826733735 (311h42m16.288826208s) [noise=true , address=77.90.31.13:4628 , piece_id=COBWCI5NBCEAC6DXPZDRWOLOLKRH3HSJRNHNQ3D7QDFUFHWIY6EA, seg_pos={0 0}, upload=274317]: Long tail cancellation due to optimal threshold
Oct 6 13:13:30.826772569 (311h42m16.288865052s) [seg_pos={0 0}, upload=274317]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 6 13:13:30.826865376 (311h42m16.288957909s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 6 13:13:30.826872319 (311h42m16.288964802s) [upload=274317]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 6 13:13:39.169097752 (311h42m24.631190225s) [upload=274317]: Done uploading segments...
Oct 6 13:13:39.169116778 (311h42m24.631209251s) [upload=274317]: Upload finished. err: <nil>
Duration: 30.003964627s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.401987935s
FAIL (2025-10-06 11:43:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.40203343s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.470277544s
FAIL (2025-10-06 11:43:14 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.470454681s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.763946793s
FAIL (2025-10-06 11:42:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.763975136s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.454545344s
FAIL (2025-10-06 11:41:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.454568527s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.469224316s
FAIL (2025-10-06 11:40:52 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.469253101s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.551677611s
FAIL (2025-10-06 11:40:03 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.551705635s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.395036416s
FAIL (2025-10-06 11:39:05 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.395070561s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.673138152s
FAIL (2025-10-06 11:38:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.673156426s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.437564449s
FAIL (2025-10-06 11:37:27 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.437616839s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.453277931s
FAIL (2025-10-06 11:36:27 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.45330302s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.435550203s
FAIL (2025-10-06 11:35:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.435601299s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.394989278s
FAIL (2025-10-06 11:34:53 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.395018362s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.478391262s
FAIL (2025-10-06 11:34:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.478419727s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.380304396s
FAIL (2025-10-06 11:33:40 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.380335405s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.659925308s
FAIL (2025-10-06 11:33:14 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.659954303s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.436904785s
FAIL (2025-10-06 11:32:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.436979457s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.331982994s
FAIL (2025-10-06 11:31:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.332008852s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.30903206s
FAIL (2025-10-06 11:31:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.309139976s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.354749204s
FAIL (2025-10-06 11:30:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.354777519s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.429487519s
FAIL (2025-10-06 11:29:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.429514322s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.511951699s
FAIL (2025-10-06 11:28:58 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.511980274s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.471172206s
FAIL (2025-10-06 11:28:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.471206072s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.369888692s
FAIL (2025-10-06 11:27:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.369955079s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.374914242s
FAIL (2025-10-06 11:26:30 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.374943528s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.68239648s
FAIL (2025-10-06 11:25:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.682422309s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.326397136s
FAIL (2025-10-06 11:24:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.326426893s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.461542961s
FAIL (2025-10-06 11:23:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.461572226s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.398599386s
FAIL (2025-10-06 11:22:52 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.398657164s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.349735197s
FAIL (2025-10-06 11:22:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.349764575s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.322312818s
FAIL (2025-10-06 11:21:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.322340081s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.577287321s
FAIL (2025-10-06 11:21:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.577319383s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.519962854s
FAIL (2025-10-06 11:20:07 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.520034751s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.687018227s
FAIL (2025-10-06 11:19:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.687047213s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.626749086s
FAIL (2025-10-06 11:19:19 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.626778883s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.320969662s
FAIL (2025-10-06 11:18:43 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.321002195s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.501369659s
FAIL (2025-10-06 11:18:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.501397934s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.512494282s
FAIL (2025-10-06 11:17:39 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.512534719s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.400331496s
FAIL (2025-10-06 11:16:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.400357476s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.468827373s
FAIL (2025-10-06 11:15:58 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.468853833s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.421370972s
FAIL (2025-10-06 11:15:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.421395708s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.410086539s
FAIL (2025-10-06 11:15:14 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.410122025s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.401164911s
FAIL (2025-10-06 11:14:22 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.401192963s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.895819582s
FAIL (2025-10-06 11:13:08 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 1.895853177s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.268621754s
FAIL (2025-10-06 11:12:36 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.268647261s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.477019652s
FAIL (2025-10-06 11:12:08 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:33064->45.38.24.2:443: read: connection reset by peer
Duration: 2.477053237s
edge
gateway
us-select-1
|