Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.937828636s trace:
https://jaeger.dev.storj.io/trace/de69fa036d8b02
FAIL (2026-01-12 18:45:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ) context deadline exceeded; piecestore: (Node ID: 1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE, Piece ID: EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A) context deadline exceeded; piecestore: (Node ID: 1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, Piece ID: 65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ) context deadline exceeded; piecestore: (Node ID: 1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, Piece ID: I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ) context deadline exceeded; piecestore: (Node ID: 18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, Piece ID: HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ) context deadline exceeded
======LOGS======
Jan 12 18:43:13.858719809 (915h14m13.729802844s) [upload=801054]: Starting upload
Jan 12 18:43:13.858805642 (915h14m13.729888677s) [upload=801054]: Done starting upload
Jan 12 18:43:13.858880885 (915h14m13.72996393s) [upload=801054]: Uploading segments...
Jan 12 18:43:13.859066038 (915h14m13.730149083s) [upload=801054]: Got next segment. Inline: false
Jan 12 18:43:13.859125010 (915h14m13.730208045s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 12 18:43:13.859131923 (915h14m13.730214968s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 12 18:43:15.358668982 (915h14m15.229752017s) [seg_pos={0 0}, upload=801054]: Begin upload segment...
Jan 12 18:43:15.358714368 (915h14m15.229797413s) [seg_pos={0 0}, upload=801054]: Done begin upload segment.
Jan 12 18:43:15.358745317 (915h14m15.229828352s) [noise=true , address=77.90.31.12:4590 , piece_id=LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.358908408 (915h14m15.229991453s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.359387038 (915h14m15.230470083s) [noise=true , address=145.79.227.44:4194 , piece_id=PKZFIIDQYD5O2P25BKIMA45XLXVXZQSLV5H7A2JJGG7XOAHOO2QA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.359851062 (915h14m15.230934107s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360286561 (915h14m15.231369606s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360600609 (915h14m15.231683654s) [noise=true , address=145.79.227.29:4943 , piece_id=EHLLIAZBTJOBDU2VLA2JXDVQK67WSCRU3FR24HBWK2QF2A5XUERA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360877186 (915h14m15.231960231s) [noise=true , address=77.90.31.19:4841 , piece_id=PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.361298538 (915h14m15.232381573s) [noise=true , address=145.79.227.49:4337 , piece_id=EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.362993415 (915h14m15.23407645s) [noise=true , address=45.91.116.14:4189 , piece_id=I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.363095780 (915h14m15.234178825s) [noise=true , address=45.91.116.7:4012 , piece_id=YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.364580467 (915h14m15.235663502s) [noise=true , address=145.79.227.16:4909 , piece_id=HS23LZ37LL6QR5D2Q4WFE7W5VQPFCOV2MQNM3PTUCMPCJ2VNDHLQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.366070103 (915h14m15.237153148s) [noise=true , address=45.91.116.8:4048 , piece_id=65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.367535814 (915h14m15.238618859s) [noise=true , address=145.79.227.48:4301 , piece_id=HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.369525412 (915h14m15.240608457s) [noise=true , address=45.91.116.6:4974 , piece_id=FRJDOIXXLZMS3FW4X4XAYAIOHTDZ5B7TWCGGM2DY5LTV5RZGU6HQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.371063701 (915h14m15.242146736s) [noise=true , address=145.79.227.2:4115 , piece_id=PB2JJEZEXSLTXW5QTHA6IWT32UMAI5EM3S5TL2CGP7A6A3NLA3GA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.372642217 (915h14m15.243725262s) [noise=true , address=77.90.31.11:4554 , piece_id=H7TROB4ZL5AENH4XYEE3SIFZFXDOE6PKO3AQUA2MACPQYLWJ4XPQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:17.184597103 (915h14m17.055680148s) [upload=801054]: Next returned nil segment
Jan 12 18:43:17.184643092 (915h14m17.055726127s) [upload=801054]: Waiting for error group managing segments...
Jan 12 18:43:17.495324372 (915h14m17.366407407s) [noise=true , address=145.79.227.49:4337 , piece_id=EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.525651226 (915h14m17.396734261s) [noise=true , address=145.79.227.48:4301 , piece_id=HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.536956361 (915h14m17.408039396s) [noise=true , address=145.79.227.16:4909 , piece_id=HS23LZ37LL6QR5D2Q4WFE7W5VQPFCOV2MQNM3PTUCMPCJ2VNDHLQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.624655888 (915h14m17.495738933s) [noise=true , address=45.91.116.6:4974 , piece_id=FRJDOIXXLZMS3FW4X4XAYAIOHTDZ5B7TWCGGM2DY5LTV5RZGU6HQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.629752162 (915h14m17.500835197s) [noise=true , address=45.91.116.7:4012 , piece_id=YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.645478456 (915h14m17.516561491s) [noise=true , address=145.79.227.2:4115 , piece_id=PB2JJEZEXSLTXW5QTHA6IWT32UMAI5EM3S5TL2CGP7A6A3NLA3GA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.676056038 (915h14m17.547139083s) [noise=true , address=45.91.116.14:4189 , piece_id=I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.698909442 (915h14m17.569992488s) [noise=true , address=45.91.116.8:4048 , piece_id=65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.721440313 (915h14m17.592523348s) [noise=true , address=77.90.31.11:4554 , piece_id=H7TROB4ZL5AENH4XYEE3SIFZFXDOE6PKO3AQUA2MACPQYLWJ4XPQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.918612414 (915h14m17.789695459s) [noise=true , address=145.79.227.44:4194 , piece_id=PKZFIIDQYD5O2P25BKIMA45XLXVXZQSLV5H7A2JJGG7XOAHOO2QA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.518838258 (915h14m18.389921293s) [noise=true , address=145.79.227.29:4943 , piece_id=EHLLIAZBTJOBDU2VLA2JXDVQK67WSCRU3FR24HBWK2QF2A5XUERA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.721493959 (915h14m18.592576994s) [noise=true , address=77.90.31.19:4841 , piece_id=PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.727505725 (915h14m18.59858876s) [noise=true , address=77.90.31.12:4590 , piece_id=LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.727530473 (915h14m18.598613518s) [seg_pos={0 0}, upload=801054]: Segment reached optimal threshold of 13 pieces.
Jan 12 18:43:18.727812850 (915h14m18.598895885s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.727825525 (915h14m18.59890856s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728214255 (915h14m18.59929729s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.728221819 (915h14m18.599304854s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728386072 (915h14m18.599469107s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.728392494 (915h14m18.599475529s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728413945 (915h14m18.59949698s) [seg_pos={0 0}, upload=801054]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 12 18:43:18.728512563 (915h14m18.599595598s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 12 18:43:18.728518674 (915h14m18.599601719s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 12 18:43:19.041837336 (915h14m18.912920371s) [upload=801054]: Done uploading segments...
Jan 12 18:43:19.041856071 (915h14m18.912939116s) [upload=801054]: Upload finished. err: <nil>
Duration: 5.937857482s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
6.00729924s trace:
https://jaeger.dev.storj.io/trace/de69fa036d8b02
FAIL (2026-01-12 18:44:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ) context deadline exceeded; piecestore: (Node ID: 1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE, Piece ID: EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A) context deadline exceeded; piecestore: (Node ID: 1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, Piece ID: 65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ) context deadline exceeded; piecestore: (Node ID: 1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, Piece ID: I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ) context deadline exceeded; piecestore: (Node ID: 18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, Piece ID: HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ) context deadline exceeded
======LOGS======
Jan 12 18:43:13.858719809 (915h14m13.729802844s) [upload=801054]: Starting upload
Jan 12 18:43:13.858805642 (915h14m13.729888677s) [upload=801054]: Done starting upload
Jan 12 18:43:13.858880885 (915h14m13.72996393s) [upload=801054]: Uploading segments...
Jan 12 18:43:13.859066038 (915h14m13.730149083s) [upload=801054]: Got next segment. Inline: false
Jan 12 18:43:13.859125010 (915h14m13.730208045s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 12 18:43:13.859131923 (915h14m13.730214968s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 12 18:43:15.358668982 (915h14m15.229752017s) [seg_pos={0 0}, upload=801054]: Begin upload segment...
Jan 12 18:43:15.358714368 (915h14m15.229797413s) [seg_pos={0 0}, upload=801054]: Done begin upload segment.
Jan 12 18:43:15.358745317 (915h14m15.229828352s) [noise=true , address=77.90.31.12:4590 , piece_id=LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.358908408 (915h14m15.229991453s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.359387038 (915h14m15.230470083s) [noise=true , address=145.79.227.44:4194 , piece_id=PKZFIIDQYD5O2P25BKIMA45XLXVXZQSLV5H7A2JJGG7XOAHOO2QA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.359851062 (915h14m15.230934107s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360286561 (915h14m15.231369606s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360600609 (915h14m15.231683654s) [noise=true , address=145.79.227.29:4943 , piece_id=EHLLIAZBTJOBDU2VLA2JXDVQK67WSCRU3FR24HBWK2QF2A5XUERA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360877186 (915h14m15.231960231s) [noise=true , address=77.90.31.19:4841 , piece_id=PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.361298538 (915h14m15.232381573s) [noise=true , address=145.79.227.49:4337 , piece_id=EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.362993415 (915h14m15.23407645s) [noise=true , address=45.91.116.14:4189 , piece_id=I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.363095780 (915h14m15.234178825s) [noise=true , address=45.91.116.7:4012 , piece_id=YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.364580467 (915h14m15.235663502s) [noise=true , address=145.79.227.16:4909 , piece_id=HS23LZ37LL6QR5D2Q4WFE7W5VQPFCOV2MQNM3PTUCMPCJ2VNDHLQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.366070103 (915h14m15.237153148s) [noise=true , address=45.91.116.8:4048 , piece_id=65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.367535814 (915h14m15.238618859s) [noise=true , address=145.79.227.48:4301 , piece_id=HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.369525412 (915h14m15.240608457s) [noise=true , address=45.91.116.6:4974 , piece_id=FRJDOIXXLZMS3FW4X4XAYAIOHTDZ5B7TWCGGM2DY5LTV5RZGU6HQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.371063701 (915h14m15.242146736s) [noise=true , address=145.79.227.2:4115 , piece_id=PB2JJEZEXSLTXW5QTHA6IWT32UMAI5EM3S5TL2CGP7A6A3NLA3GA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.372642217 (915h14m15.243725262s) [noise=true , address=77.90.31.11:4554 , piece_id=H7TROB4ZL5AENH4XYEE3SIFZFXDOE6PKO3AQUA2MACPQYLWJ4XPQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:17.184597103 (915h14m17.055680148s) [upload=801054]: Next returned nil segment
Jan 12 18:43:17.184643092 (915h14m17.055726127s) [upload=801054]: Waiting for error group managing segments...
Jan 12 18:43:17.495324372 (915h14m17.366407407s) [noise=true , address=145.79.227.49:4337 , piece_id=EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.525651226 (915h14m17.396734261s) [noise=true , address=145.79.227.48:4301 , piece_id=HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.536956361 (915h14m17.408039396s) [noise=true , address=145.79.227.16:4909 , piece_id=HS23LZ37LL6QR5D2Q4WFE7W5VQPFCOV2MQNM3PTUCMPCJ2VNDHLQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.624655888 (915h14m17.495738933s) [noise=true , address=45.91.116.6:4974 , piece_id=FRJDOIXXLZMS3FW4X4XAYAIOHTDZ5B7TWCGGM2DY5LTV5RZGU6HQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.629752162 (915h14m17.500835197s) [noise=true , address=45.91.116.7:4012 , piece_id=YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.645478456 (915h14m17.516561491s) [noise=true , address=145.79.227.2:4115 , piece_id=PB2JJEZEXSLTXW5QTHA6IWT32UMAI5EM3S5TL2CGP7A6A3NLA3GA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.676056038 (915h14m17.547139083s) [noise=true , address=45.91.116.14:4189 , piece_id=I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.698909442 (915h14m17.569992488s) [noise=true , address=45.91.116.8:4048 , piece_id=65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.721440313 (915h14m17.592523348s) [noise=true , address=77.90.31.11:4554 , piece_id=H7TROB4ZL5AENH4XYEE3SIFZFXDOE6PKO3AQUA2MACPQYLWJ4XPQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.918612414 (915h14m17.789695459s) [noise=true , address=145.79.227.44:4194 , piece_id=PKZFIIDQYD5O2P25BKIMA45XLXVXZQSLV5H7A2JJGG7XOAHOO2QA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.518838258 (915h14m18.389921293s) [noise=true , address=145.79.227.29:4943 , piece_id=EHLLIAZBTJOBDU2VLA2JXDVQK67WSCRU3FR24HBWK2QF2A5XUERA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.721493959 (915h14m18.592576994s) [noise=true , address=77.90.31.19:4841 , piece_id=PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.727505725 (915h14m18.59858876s) [noise=true , address=77.90.31.12:4590 , piece_id=LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.727530473 (915h14m18.598613518s) [seg_pos={0 0}, upload=801054]: Segment reached optimal threshold of 13 pieces.
Jan 12 18:43:18.727812850 (915h14m18.598895885s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.727825525 (915h14m18.59890856s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728214255 (915h14m18.59929729s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.728221819 (915h14m18.599304854s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728386072 (915h14m18.599469107s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.728392494 (915h14m18.599475529s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728413945 (915h14m18.59949698s) [seg_pos={0 0}, upload=801054]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 12 18:43:18.728512563 (915h14m18.599595598s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 12 18:43:18.728518674 (915h14m18.599601719s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 12 18:43:19.041837336 (915h14m18.912920371s) [upload=801054]: Done uploading segments...
Jan 12 18:43:19.041856071 (915h14m18.912939116s) [upload=801054]: Upload finished. err: <nil>
Duration: 6.007323357s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
34 out of 60 is failed (threshold=6) [X.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.X....XX..] duration:
5.001244786s trace:
https://jaeger.dev.storj.io/trace/64e8accbe0a8a091
FAIL (2026-01-12 18:44:20 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001268662s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
27.777952452s trace:
https://jaeger.dev.storj.io/trace/de69fa036d8b02
FAIL (2026-01-12 18:44:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ) context deadline exceeded; piecestore: (Node ID: 1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE, Piece ID: EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A) context deadline exceeded; piecestore: (Node ID: 1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, Piece ID: 65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ) context deadline exceeded; piecestore: (Node ID: 1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, Piece ID: I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ) context deadline exceeded; piecestore: (Node ID: 18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, Piece ID: HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ) context deadline exceeded
======LOGS======
Jan 12 18:43:13.858719809 (915h14m13.729802844s) [upload=801054]: Starting upload
Jan 12 18:43:13.858805642 (915h14m13.729888677s) [upload=801054]: Done starting upload
Jan 12 18:43:13.858880885 (915h14m13.72996393s) [upload=801054]: Uploading segments...
Jan 12 18:43:13.859066038 (915h14m13.730149083s) [upload=801054]: Got next segment. Inline: false
Jan 12 18:43:13.859125010 (915h14m13.730208045s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 12 18:43:13.859131923 (915h14m13.730214968s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 12 18:43:15.358668982 (915h14m15.229752017s) [seg_pos={0 0}, upload=801054]: Begin upload segment...
Jan 12 18:43:15.358714368 (915h14m15.229797413s) [seg_pos={0 0}, upload=801054]: Done begin upload segment.
Jan 12 18:43:15.358745317 (915h14m15.229828352s) [noise=true , address=77.90.31.12:4590 , piece_id=LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.358908408 (915h14m15.229991453s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.359387038 (915h14m15.230470083s) [noise=true , address=145.79.227.44:4194 , piece_id=PKZFIIDQYD5O2P25BKIMA45XLXVXZQSLV5H7A2JJGG7XOAHOO2QA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.359851062 (915h14m15.230934107s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360286561 (915h14m15.231369606s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360600609 (915h14m15.231683654s) [noise=true , address=145.79.227.29:4943 , piece_id=EHLLIAZBTJOBDU2VLA2JXDVQK67WSCRU3FR24HBWK2QF2A5XUERA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360877186 (915h14m15.231960231s) [noise=true , address=77.90.31.19:4841 , piece_id=PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.361298538 (915h14m15.232381573s) [noise=true , address=145.79.227.49:4337 , piece_id=EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.362993415 (915h14m15.23407645s) [noise=true , address=45.91.116.14:4189 , piece_id=I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.363095780 (915h14m15.234178825s) [noise=true , address=45.91.116.7:4012 , piece_id=YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.364580467 (915h14m15.235663502s) [noise=true , address=145.79.227.16:4909 , piece_id=HS23LZ37LL6QR5D2Q4WFE7W5VQPFCOV2MQNM3PTUCMPCJ2VNDHLQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.366070103 (915h14m15.237153148s) [noise=true , address=45.91.116.8:4048 , piece_id=65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.367535814 (915h14m15.238618859s) [noise=true , address=145.79.227.48:4301 , piece_id=HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.369525412 (915h14m15.240608457s) [noise=true , address=45.91.116.6:4974 , piece_id=FRJDOIXXLZMS3FW4X4XAYAIOHTDZ5B7TWCGGM2DY5LTV5RZGU6HQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.371063701 (915h14m15.242146736s) [noise=true , address=145.79.227.2:4115 , piece_id=PB2JJEZEXSLTXW5QTHA6IWT32UMAI5EM3S5TL2CGP7A6A3NLA3GA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.372642217 (915h14m15.243725262s) [noise=true , address=77.90.31.11:4554 , piece_id=H7TROB4ZL5AENH4XYEE3SIFZFXDOE6PKO3AQUA2MACPQYLWJ4XPQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:17.184597103 (915h14m17.055680148s) [upload=801054]: Next returned nil segment
Jan 12 18:43:17.184643092 (915h14m17.055726127s) [upload=801054]: Waiting for error group managing segments...
Jan 12 18:43:17.495324372 (915h14m17.366407407s) [noise=true , address=145.79.227.49:4337 , piece_id=EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.525651226 (915h14m17.396734261s) [noise=true , address=145.79.227.48:4301 , piece_id=HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.536956361 (915h14m17.408039396s) [noise=true , address=145.79.227.16:4909 , piece_id=HS23LZ37LL6QR5D2Q4WFE7W5VQPFCOV2MQNM3PTUCMPCJ2VNDHLQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.624655888 (915h14m17.495738933s) [noise=true , address=45.91.116.6:4974 , piece_id=FRJDOIXXLZMS3FW4X4XAYAIOHTDZ5B7TWCGGM2DY5LTV5RZGU6HQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.629752162 (915h14m17.500835197s) [noise=true , address=45.91.116.7:4012 , piece_id=YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.645478456 (915h14m17.516561491s) [noise=true , address=145.79.227.2:4115 , piece_id=PB2JJEZEXSLTXW5QTHA6IWT32UMAI5EM3S5TL2CGP7A6A3NLA3GA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.676056038 (915h14m17.547139083s) [noise=true , address=45.91.116.14:4189 , piece_id=I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.698909442 (915h14m17.569992488s) [noise=true , address=45.91.116.8:4048 , piece_id=65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.721440313 (915h14m17.592523348s) [noise=true , address=77.90.31.11:4554 , piece_id=H7TROB4ZL5AENH4XYEE3SIFZFXDOE6PKO3AQUA2MACPQYLWJ4XPQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.918612414 (915h14m17.789695459s) [noise=true , address=145.79.227.44:4194 , piece_id=PKZFIIDQYD5O2P25BKIMA45XLXVXZQSLV5H7A2JJGG7XOAHOO2QA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.518838258 (915h14m18.389921293s) [noise=true , address=145.79.227.29:4943 , piece_id=EHLLIAZBTJOBDU2VLA2JXDVQK67WSCRU3FR24HBWK2QF2A5XUERA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.721493959 (915h14m18.592576994s) [noise=true , address=77.90.31.19:4841 , piece_id=PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.727505725 (915h14m18.59858876s) [noise=true , address=77.90.31.12:4590 , piece_id=LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.727530473 (915h14m18.598613518s) [seg_pos={0 0}, upload=801054]: Segment reached optimal threshold of 13 pieces.
Jan 12 18:43:18.727812850 (915h14m18.598895885s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.727825525 (915h14m18.59890856s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728214255 (915h14m18.59929729s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.728221819 (915h14m18.599304854s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728386072 (915h14m18.599469107s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.728392494 (915h14m18.599475529s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728413945 (915h14m18.59949698s) [seg_pos={0 0}, upload=801054]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 12 18:43:18.728512563 (915h14m18.599595598s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 12 18:43:18.728518674 (915h14m18.599601719s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 12 18:43:19.041837336 (915h14m18.912920371s) [upload=801054]: Done uploading segments...
Jan 12 18:43:19.041856071 (915h14m18.912939116s) [upload=801054]: Upload finished. err: <nil>
Duration: 27.777978392s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001664703s trace:
https://jaeger.dev.storj.io/trace/de69fa036d8b02
FAIL (2026-01-12 18:43:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A) context deadline exceeded; piecestore: (Node ID: 1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, Piece ID: YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ) context deadline exceeded; piecestore: (Node ID: 1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE, Piece ID: EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A) context deadline exceeded; piecestore: (Node ID: 1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, Piece ID: 65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ) context deadline exceeded; piecestore: (Node ID: 1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, Piece ID: I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ) context deadline exceeded; piecestore: (Node ID: 18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, Piece ID: HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ) context deadline exceeded
======LOGS======
Jan 12 18:43:13.858719809 (915h14m13.729802844s) [upload=801054]: Starting upload
Jan 12 18:43:13.858805642 (915h14m13.729888677s) [upload=801054]: Done starting upload
Jan 12 18:43:13.858880885 (915h14m13.72996393s) [upload=801054]: Uploading segments...
Jan 12 18:43:13.859066038 (915h14m13.730149083s) [upload=801054]: Got next segment. Inline: false
Jan 12 18:43:13.859125010 (915h14m13.730208045s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 12 18:43:13.859131923 (915h14m13.730214968s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 12 18:43:15.358668982 (915h14m15.229752017s) [seg_pos={0 0}, upload=801054]: Begin upload segment...
Jan 12 18:43:15.358714368 (915h14m15.229797413s) [seg_pos={0 0}, upload=801054]: Done begin upload segment.
Jan 12 18:43:15.358745317 (915h14m15.229828352s) [noise=true , address=77.90.31.12:4590 , piece_id=LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.358908408 (915h14m15.229991453s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.359387038 (915h14m15.230470083s) [noise=true , address=145.79.227.44:4194 , piece_id=PKZFIIDQYD5O2P25BKIMA45XLXVXZQSLV5H7A2JJGG7XOAHOO2QA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.359851062 (915h14m15.230934107s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360286561 (915h14m15.231369606s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360600609 (915h14m15.231683654s) [noise=true , address=145.79.227.29:4943 , piece_id=EHLLIAZBTJOBDU2VLA2JXDVQK67WSCRU3FR24HBWK2QF2A5XUERA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.360877186 (915h14m15.231960231s) [noise=true , address=77.90.31.19:4841 , piece_id=PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.361298538 (915h14m15.232381573s) [noise=true , address=145.79.227.49:4337 , piece_id=EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.362993415 (915h14m15.23407645s) [noise=true , address=45.91.116.14:4189 , piece_id=I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.363095780 (915h14m15.234178825s) [noise=true , address=45.91.116.7:4012 , piece_id=YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.364580467 (915h14m15.235663502s) [noise=true , address=145.79.227.16:4909 , piece_id=HS23LZ37LL6QR5D2Q4WFE7W5VQPFCOV2MQNM3PTUCMPCJ2VNDHLQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.366070103 (915h14m15.237153148s) [noise=true , address=45.91.116.8:4048 , piece_id=65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.367535814 (915h14m15.238618859s) [noise=true , address=145.79.227.48:4301 , piece_id=HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.369525412 (915h14m15.240608457s) [noise=true , address=45.91.116.6:4974 , piece_id=FRJDOIXXLZMS3FW4X4XAYAIOHTDZ5B7TWCGGM2DY5LTV5RZGU6HQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.371063701 (915h14m15.242146736s) [noise=true , address=145.79.227.2:4115 , piece_id=PB2JJEZEXSLTXW5QTHA6IWT32UMAI5EM3S5TL2CGP7A6A3NLA3GA, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:15.372642217 (915h14m15.243725262s) [noise=true , address=77.90.31.11:4554 , piece_id=H7TROB4ZL5AENH4XYEE3SIFZFXDOE6PKO3AQUA2MACPQYLWJ4XPQ, seg_pos={0 0}, upload=801054]: Uploading piece...
Jan 12 18:43:17.184597103 (915h14m17.055680148s) [upload=801054]: Next returned nil segment
Jan 12 18:43:17.184643092 (915h14m17.055726127s) [upload=801054]: Waiting for error group managing segments...
Jan 12 18:43:17.495324372 (915h14m17.366407407s) [noise=true , address=145.79.227.49:4337 , piece_id=EVS5VGPO6WLN3C2VP3UAVYUYHPXLAZYNRZ2GA2PVZUTXXP3H6O3A, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.525651226 (915h14m17.396734261s) [noise=true , address=145.79.227.48:4301 , piece_id=HRTH34C6ZEOCR5MHVP4DVP4WZ67UU3HRZUBONPRYCIXCDRNLEYNQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.536956361 (915h14m17.408039396s) [noise=true , address=145.79.227.16:4909 , piece_id=HS23LZ37LL6QR5D2Q4WFE7W5VQPFCOV2MQNM3PTUCMPCJ2VNDHLQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.624655888 (915h14m17.495738933s) [noise=true , address=45.91.116.6:4974 , piece_id=FRJDOIXXLZMS3FW4X4XAYAIOHTDZ5B7TWCGGM2DY5LTV5RZGU6HQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.629752162 (915h14m17.500835197s) [noise=true , address=45.91.116.7:4012 , piece_id=YV2L3R4VSD5QKHQZKQWONN4P46FJGOO5L6AZEIOYIWVZCGIZTDGQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.645478456 (915h14m17.516561491s) [noise=true , address=145.79.227.2:4115 , piece_id=PB2JJEZEXSLTXW5QTHA6IWT32UMAI5EM3S5TL2CGP7A6A3NLA3GA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.676056038 (915h14m17.547139083s) [noise=true , address=45.91.116.14:4189 , piece_id=I2EFYW6P6U7ZBBWJCJZYBL72LJAT23FOUKGXUIXFEFVEZTFJU6ZQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.698909442 (915h14m17.569992488s) [noise=true , address=45.91.116.8:4048 , piece_id=65GAA4HMN5XYFMGEAUDDVNK23RYPF2QHIWZ77KPNRZZXR3K4YRFQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.721440313 (915h14m17.592523348s) [noise=true , address=77.90.31.11:4554 , piece_id=H7TROB4ZL5AENH4XYEE3SIFZFXDOE6PKO3AQUA2MACPQYLWJ4XPQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:17.918612414 (915h14m17.789695459s) [noise=true , address=145.79.227.44:4194 , piece_id=PKZFIIDQYD5O2P25BKIMA45XLXVXZQSLV5H7A2JJGG7XOAHOO2QA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.518838258 (915h14m18.389921293s) [noise=true , address=145.79.227.29:4943 , piece_id=EHLLIAZBTJOBDU2VLA2JXDVQK67WSCRU3FR24HBWK2QF2A5XUERA, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.721493959 (915h14m18.592576994s) [noise=true , address=77.90.31.19:4841 , piece_id=PT73NOB5J5RN3YYO2FQOI5WAQHF4VVVMOPRZRS4VAZWPAUBH7G3A, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.727505725 (915h14m18.59858876s) [noise=true , address=77.90.31.12:4590 , piece_id=LHCNG3FICWGL4F7CEF5SAJPHKTWDND6GEZZ6PC33SZMJKE465DSQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: <nil>
Jan 12 18:43:18.727530473 (915h14m18.598613518s) [seg_pos={0 0}, upload=801054]: Segment reached optimal threshold of 13 pieces.
Jan 12 18:43:18.727812850 (915h14m18.598895885s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.727825525 (915h14m18.59890856s) [noise=true , address=45.91.116.5:4300 , piece_id=WEKZBTQJ3JFDFXNKQ6KDSQ3LKCZOSZTGBR5B65N3WTVRKGBL5R2Q, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728214255 (915h14m18.59929729s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.728221819 (915h14m18.599304854s) [noise=true , address=77.90.31.10:4519 , piece_id=ACYFGWKK7E2TIGLTJVMXZYCLFRX44VXZYHHHTHQYUDDC2NFQXFTQ, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728386072 (915h14m18.599469107s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF
Jan 12 18:43:18.728392494 (915h14m18.599475529s) [noise=true , address=77.90.31.21:4877 , piece_id=F4RTMXI3C3YHKZ3L4LT5R7MDK37GMN3VGSMDJX22TOWDHLLLMFFQ, seg_pos={0 0}, upload=801054]: Long tail cancellation due to optimal threshold
Jan 12 18:43:18.728413945 (915h14m18.59949698s) [seg_pos={0 0}, upload=801054]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 12 18:43:18.728512563 (915h14m18.599595598s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 12 18:43:18.728518674 (915h14m18.599601719s) [upload=801054]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 12 18:43:19.041837336 (915h14m18.912920371s) [upload=801054]: Done uploading segments...
Jan 12 18:43:19.041856071 (915h14m18.912939116s) [upload=801054]: Upload finished. err: <nil>
Duration: 30.001685723s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
35 out of 60 is failed (threshold=6) [XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.X....XX.] duration:
5.000287747s trace:
https://jaeger.dev.storj.io/trace/64e8accbe0a8a091
FAIL (2026-01-12 18:43:06 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000329095s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
35 out of 60 is failed (threshold=6) [.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.X....XX] duration:
5.00134462s trace:
https://jaeger.dev.storj.io/trace/64e8accbe0a8a091
FAIL (2026-01-12 18:42:38 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001368535s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
35 out of 60 is failed (threshold=6) [X.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.X....X] duration:
5.000684152s trace:
https://jaeger.dev.storj.io/trace/2e7e74808d2f5372
FAIL (2026-01-12 18:41:55 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000723215s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
35 out of 60 is failed (threshold=6) [XX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.X....] duration:
3.901477541s trace:
https://jaeger.dev.storj.io/trace/1ae2b435195e3f1
FAIL (2026-01-12 18:41:32 UTC)
orbiter warning: context deadline exceeded
Duration: 3.901505816s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
36 out of 60 is failed (threshold=6) [XXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.X...] duration:
5.000643925s trace:
https://jaeger.dev.storj.io/trace/1ae2b435195e3f1
FAIL (2026-01-12 18:40:28 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000671147s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
37 out of 60 is failed (threshold=6) [XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.X..] duration:
3.549055553s trace:
https://jaeger.dev.storj.io/trace/1ae2b435195e3f1
FAIL (2026-01-12 18:39:41 UTC)
orbiter warning: context deadline exceeded
Duration: 3.54908091s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
37 out of 60 is failed (threshold=6) [.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.X.] duration:
4.321392382s trace:
https://jaeger.dev.storj.io/trace/1ae2b435195e3f1
FAIL (2026-01-12 18:38:37 UTC)
orbiter warning: context deadline exceeded
Duration: 4.321417439s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
38 out of 60 is failed (threshold=6) [X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.X] duration:
5.00186891s trace:
https://jaeger.dev.storj.io/trace/1ae2b435195e3f1
FAIL (2026-01-12 18:37:34 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001891273s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
37 out of 60 is failed (threshold=6) [.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X.] duration:
5.000719699s trace:
https://jaeger.dev.storj.io/trace/63b71b9f32dfcfce
FAIL (2026-01-12 18:37:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000737171s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
38 out of 60 is failed (threshold=6) [X.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.X] duration:
5.00167084s trace:
https://jaeger.dev.storj.io/trace/63b71b9f32dfcfce
FAIL (2026-01-12 18:36:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.00169205s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
38 out of 60 is failed (threshold=6) [XX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X.] duration:
5.000883954s trace:
https://jaeger.dev.storj.io/trace/3e9716ec7c9a2670
FAIL (2026-01-12 18:35:41 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001028279s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
39 out of 60 is failed (threshold=6) [XXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..X] duration:
5.001474246s trace:
https://jaeger.dev.storj.io/trace/3e9716ec7c9a2670
FAIL (2026-01-12 18:35:21 UTC)
orbiter warning: context deadline exceeded
Duration: 5.00149675s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
39 out of 60 is failed (threshold=6) [XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X..] duration:
3.662465947s trace:
https://jaeger.dev.storj.io/trace/11338ff50a98690e
FAIL (2026-01-12 18:34:10 UTC)
orbiter warning: context deadline exceeded
Duration: 3.662495523s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
39 out of 60 is failed (threshold=6) [.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X.] duration:
3.548155079s trace:
https://jaeger.dev.storj.io/trace/11338ff50a98690e
FAIL (2026-01-12 18:32:59 UTC)
orbiter warning: context deadline exceeded
Duration: 3.548184525s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [X.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.X] duration:
5.001336641s trace:
https://jaeger.dev.storj.io/trace/11338ff50a98690e
FAIL (2026-01-12 18:32:14 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001356979s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [XX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX.] duration:
4.071273515s trace:
https://jaeger.dev.storj.io/trace/41cbe3f7026eaacb
FAIL (2026-01-12 18:31:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.07130153s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XXX] duration:
5.001097244s trace:
https://jaeger.dev.storj.io/trace/41cbe3f7026eaacb
FAIL (2026-01-12 18:30:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001120998s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.XX] duration:
5.001178362s trace:
https://jaeger.dev.storj.io/trace/6d2642084c58b20
FAIL (2026-01-12 18:30:08 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001202688s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [X.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.X] duration:
5.001569734s trace:
https://jaeger.dev.storj.io/trace/5ff57399adfb1254
FAIL (2026-01-12 18:29:36 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001590443s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [XX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X.] duration:
3.506893744s trace:
https://jaeger.dev.storj.io/trace/5213d501e303c6ce
FAIL (2026-01-12 18:28:48 UTC)
orbiter warning: context deadline exceeded
Duration: 3.506967535s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....X] duration:
5.00190389s trace:
https://jaeger.dev.storj.io/trace/5213d501e303c6ce
FAIL (2026-01-12 18:28:06 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001921594s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [.XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX....] duration:
3.60453984s trace:
https://jaeger.dev.storj.io/trace/534efb934570921f
FAIL (2026-01-12 18:27:15 UTC)
orbiter warning: context deadline exceeded
Duration: 3.604565318s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [..XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX...] duration:
3.591345259s trace:
https://jaeger.dev.storj.io/trace/534efb934570921f
FAIL (2026-01-12 18:26:36 UTC)
orbiter warning: context deadline exceeded
Duration: 3.591367422s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [...XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX..] duration:
4.174928755s trace:
https://jaeger.dev.storj.io/trace/534efb934570921f
FAIL (2026-01-12 18:25:59 UTC)
orbiter warning: context deadline exceeded
Duration: 4.174957761s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX.] duration:
3.57690609s trace:
https://jaeger.dev.storj.io/trace/534efb934570921f
FAIL (2026-01-12 18:25:14 UTC)
orbiter warning: context deadline exceeded
Duration: 3.576930056s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.XX] duration:
5.001385284s trace:
https://jaeger.dev.storj.io/trace/534efb934570921f
FAIL (2026-01-12 18:24:07 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001415473s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [.X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.X] duration:
5.000882644s trace:
https://jaeger.dev.storj.io/trace/1b26c3ee010b4d6
FAIL (2026-01-12 18:22:53 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000904575s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
40 out of 60 is failed (threshold=6) [X.X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX.] duration:
3.610510228s trace:
https://jaeger.dev.storj.io/trace/4d405ca4e6ea9d21
FAIL (2026-01-12 18:22:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.610539183s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [XX.X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXXX] duration:
5.000862527s trace:
https://jaeger.dev.storj.io/trace/4d405ca4e6ea9d21
FAIL (2026-01-12 18:21:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000878337s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [XXX.X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXXX] duration:
5.000843263s trace:
https://jaeger.dev.storj.io/trace/5d06529cffe4b1e4
FAIL (2026-01-12 18:21:03 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000867049s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [XXXX.X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XXX] duration:
5.000978166s trace:
https://jaeger.dev.storj.io/trace/a046b6b81f40b60
FAIL (2026-01-12 18:20:26 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000999276s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [XXXXX.X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.XX] duration:
5.001431208s trace:
https://jaeger.dev.storj.io/trace/1bf1a19dfb48c004
FAIL (2026-01-12 18:20:02 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001454653s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
264.820944ms remote:
"tcp:207.211.208.129:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/c035ff06365a4fe
FAIL (2026-01-12 18:19:43 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded
Duration: 264.914192ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [XXXXXX.X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.X] duration:
5.000621718s trace:
https://jaeger.dev.storj.io/trace/4707c380bd6388c7
FAIL (2026-01-12 18:19:43 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000641045s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
261.971059ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/521cc153315f9374
FAIL (2026-01-12 18:19:41 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 261.996717ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
265.649753ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/521cc153315f9374
FAIL (2026-01-12 18:19:24 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 265.675892ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
267.335362ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/521cc153315f9374
FAIL (2026-01-12 18:19:07 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 267.361472ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
260.037587ms remote:
"tcp:207.211.208.129:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/c035ff06365a4fe
FAIL (2026-01-12 18:18:58 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded
Duration: 260.063918ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
273.234295ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/521cc153315f9374
FAIL (2026-01-12 18:18:47 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 273.26341ms
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [XXXXXXX.X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X.] duration:
3.624662836s trace:
https://jaeger.dev.storj.io/trace/10d5288731c6da28
FAIL (2026-01-12 18:18:39 UTC)
orbiter warning: context deadline exceeded
Duration: 3.624677044s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
263.292304ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/521cc153315f9374
FAIL (2026-01-12 18:18:32 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 263.316731ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
265.446898ms remote:
"tcp:207.211.208.129:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/c035ff06365a4fe
FAIL (2026-01-12 18:18:06 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded
Duration: 265.463559ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
41 out of 60 is failed (threshold=6) [.XXXXXXX.X....XXX.XXX.XXXX.X.XXXX.XX.XX.XX..X.XXXXXX.X.XXX.X] duration:
5.00098354s trace:
https://jaeger.dev.storj.io/trace/10d5288731c6da28
FAIL (2026-01-12 18:17:41 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001007625s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
268.059911ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/521cc153315f9374
FAIL (2026-01-12 18:17:29 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 268.086854ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
264.03017ms remote:
"tcp:207.211.208.129:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/c035ff06365a4fe
FAIL (2026-01-12 18:17:24 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded
Duration: 264.0563ms
edge
gateway
vhost
bgp
us1
|