Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.694687217s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:44:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 5.694699921s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..............X...X.........................................] duration:
6.679293627s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:44:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.679313276s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...............X...X........................................] duration:
6.867732129s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:43:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.867750934s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.684367278s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:43:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 5.68438885s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [................X...X.......................................] duration:
6.670010839s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:42:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.670039575s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
7.223136037s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:42:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 7.223158139s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.................X...X......................................] duration:
6.947606608s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:42:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.947644741s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.827721995s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:41:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 5.827746943s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..................X...X.....................................] duration:
7.278400475s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:41:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.278422157s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.899433319s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:41:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 5.899448386s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...................X...X....................................] duration:
6.919167188s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:40:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.919186075s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
6.675738685s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:40:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 6.675790435s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.667358189s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:39:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 5.667382104s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [....................X...X...................................] duration:
6.031575955s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:39:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.031601864s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.905723573s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:38:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 5.905747227s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration:
5.701890739s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:38:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.7019224s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
6.435816671s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:37:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 6.43584131s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [......................X...X.................................] duration:
5.74795231s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:37:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.747986305s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
4.159032071s trace:
https://jaeger.dev.storj.io/trace/7309bace5fda504b
FAIL (2026-05-06 00:37:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context canceled
======LOGS======
.374554348 (125h49m35.895378093s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 6 00:37:25.611723918 (125h49m36.132547663s) [seg_pos={0 0}, upload=120443]: Begin upload segment...
May 6 00:37:25.611788120 (125h49m36.132611885s) [seg_pos={0 0}, upload=120443]: Done begin upload segment.
May 6 00:37:25.611836733 (125h49m36.132660478s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.611855860 (125h49m36.132679615s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.612527341 (125h49m36.133351086s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613061881 (125h49m36.133885636s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.613512341 (125h49m36.134336096s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.614707422 (125h49m36.135531177s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.615796219 (125h49m36.136619964s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.616279842 (125h49m36.137103597s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.617598358 (125h49m36.138422103s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.618925220 (125h49m36.139748965s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620260308 (125h49m36.141084053s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.620633770 (125h49m36.141457515s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.621928260 (125h49m36.142752005s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.622848366 (125h49m36.143688983s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.623736612 (125h49m36.144560357s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:25.625856647 (125h49m36.146680392s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Uploading piece...
May 6 00:37:27.322013072 (125h49m37.842836827s) [upload=120443]: Next returned nil segment
May 6 00:37:27.322025576 (125h49m37.842849321s) [upload=120443]: Waiting for error group managing segments...
May 6 00:37:27.604612373 (125h49m38.125436118s) [noise=true , address=145.79.227.40:4050 , piece_id=5XDNNSC66QJ4PIOZ5WA57UCW3BWHLCPRMUY3UQCSVZ72P62DYWEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615428994 (125h49m38.136252739s) [noise=true , address=145.79.227.17:4971 , piece_id=UJ34ZA5E3UM6CRQ67FKZ65XR3BOXR27BNAYPHPV4TYIFFE3VO5KQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.615840539 (125h49m38.136664284s) [noise=true , address=145.79.227.24:4584 , piece_id=6TPNOGPN4HDKF25CNDHMZWKNWDNAEJL5NQBOA4DZJDWW77I4LDQA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.616063335 (125h49m38.13688708s) [noise=true , address=145.79.227.36:4521 , piece_id=HNC3ZXXAOCPRFUYFWB36N4I52HUZBLW57X2P22UVC3H6D4WXPA4Q, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.624558967 (125h49m38.145382712s) [noise=true , address=145.79.227.13:4806 , piece_id=LYT7BTXABBNU3VU7ATSO5CZI5KCHCTRR3TJFHM6LCVCYXILVZU6A, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.630019938 (125h49m38.150843683s) [noise=true , address=145.79.227.41:4085 , piece_id=KKBW4XLFMN2MNP2WEA6ETDRXS4BI5ZQRAM2LETVHPYKUYR4XSSVA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631393028 (125h49m38.152216783s) [noise=true , address=145.79.227.8:4335 , piece_id=WFWAGOAFWVIYA3ED4XPM2XUV7O6RO4TBNGNIYSZSHX2Y4YMBL2RA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.631619800 (125h49m38.152443546s) [noise=true , address=145.79.227.28:4726 , piece_id=CI3WYWDOEUTHB3LM5GNWOEWLE3SYQLVGRJXF5H2O5Q6PPIPTFTEQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.637472841 (125h49m38.158296576s) [noise=true , address=145.79.227.6:4259 , piece_id=55PTWNU7EIGOXD3ZFOCP4LL5CUXLVXBHUTCG3TVCU5ZIDQDHU4OA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.646377433 (125h49m38.167201178s) [noise=true , address=145.79.227.21:4474 , piece_id=3ULB5FMJH2ILASZ4Q5LLZPB3WOHZQ2PU2BSMFPPXFH47KNK7Q4VA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.653836798 (125h49m38.174660543s) [noise=true , address=77.90.31.10:4521 , piece_id=IQPFDPZZNULZRLZAOBMHWQJ7A6KNH7FDY55QKKB5P4P2OFW7I6WQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.655850541 (125h49m38.176674286s) [noise=true , address=145.79.227.11:4735 , piece_id=DEFZDSDDDJABXMCMSEAE3SOUSD2S4EL6E2EOEGYG5E6RTYCXUFFQ, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677700066 (125h49m38.198523811s) [noise=true , address=145.79.227.18:4010 , piece_id=JY5RL4EW2TOY5V2UVDMUUAJ7GI34P4NDC7FMT5QTUH6B3PBSPNKA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: <nil>
May 6 00:37:27.677718030 (125h49m38.198541775s) [seg_pos={0 0}, upload=120443]: Satisfied cohort requirements after 13 pieces
May 6 00:37:27.677917330 (125h49m38.198741076s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49622->45.91.116.4:4941: use of closed network connection
May 6 00:37:27.677923412 (125h49m38.198747157s) [noise=true , address=45.91.116.4:4941 , piece_id=4S76Q7JW7LSKPTRNHSJ4LH7HHI7L7DUM44J5UJEYHLT6DSDFEFDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678018343 (125h49m38.198842088s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uZ5svEKyXSyB2kA3DjkHS976ioUcNjFehKCcxQY2pi9iEaAAy): protocol: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55782->45.91.116.13:4156: use of closed network connection
May 6 00:37:27.678024023 (125h49m38.198847759s) [noise=true , address=45.91.116.13:4156 , piece_id=OLDZUHLDZJTH5U5QPUOUDQ3UKNUQMFFZ7CMHX6VWTAYX5MZQCYEA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678031679 (125h49m38.198855424s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51032->45.91.116.7:4009: use of closed network connection
May 6 00:37:27.678048490 (125h49m38.198872235s) [noise=true , address=45.91.116.7:4009 , piece_id=KERWC67HPMMDUY3RXHWQLHBK3C36MFFPX2ZIXRFH652AZGZEAMDA, seg_pos={0 0}, upload=120443]: Long tail cancellation due to optimal threshold
May 6 00:37:27.678113885 (125h49m38.19893763s) [seg_pos={0 0}, upload=120443]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 6 00:37:27.678193537 (125h49m38.199017322s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 6 00:37:27.678198717 (125h49m38.199022462s) [upload=120443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 6 00:37:27.970416542 (125h49m38.491240277s) [upload=120443]: Done uploading segments...
May 6 00:37:27.970433054 (125h49m38.491256799s) [upload=120443]: Upload finished. err: <nil>
Duration: 4.159054875s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...X................................] duration:
5.837108762s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:36:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.837125393s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [........................X...X...............................] duration:
5.656737081s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:36:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.656763051s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...X..............................] duration:
5.694441917s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:35:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.694476213s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...X.............................] duration:
5.546096792s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:34:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.546122191s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...X............................] duration:
6.798172531s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:33:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.798194543s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [............................X...X...........................] duration:
6.793447091s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:33:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.793475195s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...X..........................] duration:
6.717259037s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:32:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.717283984s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..............................X...X.........................] duration:
6.677429056s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:31:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.677589061s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...............................X...X........................] duration:
6.801828621s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:30:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.801850663s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [................................X...X.......................] duration:
6.609992226s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:30:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.610022243s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.................................X...X......................] duration:
6.787750355s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:29:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.787776704s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..................................X...X.....................] duration:
5.662788369s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:28:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.662835559s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...................................X...X....................] duration:
6.725765082s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:28:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.725786263s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [....................................X...X...................] duration:
13.934734053s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:27:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 13.935042242s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X...X..................] duration:
6.610671514s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:27:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.610696112s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [......................................X...X.................] duration:
6.591965887s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:26:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.591991445s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...X................] duration:
12.383467682s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:26:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 12.383491115s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [........................................X...X...............] duration:
17.033757127s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:26:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 17.033827863s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X...X..............] duration:
6.807240122s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:24:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.807266482s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X...X.............] duration:
7.494968683s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:23:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.494996926s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X...X............] duration:
26.834847289s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:23:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 26.834868689s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [............................................X...X...........] duration:
6.649571898s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:22:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.649600784s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X...X..........] duration:
42.505141385s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:22:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 42.505166613s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X...X.........] duration:
7.385830755s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:21:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.3858591s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X...X........] duration:
6.7051842s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:20:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.705200991s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [................................................X...X.......] duration:
7.051403342s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:19:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.051424402s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X...X......] duration:
6.585579669s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:19:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.585597764s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X...X.....] duration:
6.787286957s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:18:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.78731427s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X...X....] duration:
7.103140285s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:18:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.103161675s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X...X...] duration:
6.816122349s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:17:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.816137688s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X...X..] duration:
50.982546818s trace:
https://jaeger.dev.storj.io/trace/7667f23ab5b366fa
FAIL (2026-05-06 00:17:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 50.982562668s
core
uplink
us-select-1
us1-placement-20
|