Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [X................X...............X..X.......................] duration: 4.220783591s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:41:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.220803288s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.X................X...............X..X......................] duration: 4.723646992s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:40:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.723662079s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [X..XX.XX.X....X.....XX......X...........X...........X...X...] duration: 11.088600413s trace: https://jaeger.dev.storj.io/trace/5c8433962bb067ba FAIL (2026-05-25 18:40:27 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.088623396s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...X.....................................................X..] duration: 3.821638409s trace: https://jaeger.dev.storj.io/trace/4d082fcde665b7a9 FAIL (2026-05-25 18:40:21 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.821665621s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....X.....................................................X.] duration: 4.00888932s trace: https://jaeger.dev.storj.io/trace/4d082fcde665b7a9 FAIL (2026-05-25 18:39:59 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.00892028s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [.X..XX.XX.X....X.....XX......X...........X...........X...X..] duration: 7.989443463s trace: https://jaeger.dev.storj.io/trace/5c8433962bb067ba FAIL (2026-05-25 18:39:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.989458672s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [..X..XX.XX.X....X.....XX......X...........X...........X...X.] duration: 32.657582436s trace: https://jaeger.dev.storj.io/trace/5c8433962bb067ba FAIL (2026-05-25 18:39:47 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 32.657593948s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..X................X...............X..X.....................] duration: 4.172125456s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:39:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.172142347s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [...X..XX.XX.X....X.....XX......X...........X...........X...X] duration: 1m0.000941929s trace: https://jaeger.dev.storj.io/trace/5c8433962bb067ba FAIL (2026-05-25 18:39:14 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000951888s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....X.....................................................X] duration: 5.001000732s trace: https://jaeger.dev.storj.io/trace/4d082fcde665b7a9 FAIL (2026-05-25 18:38:58 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001011191s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...X................X...............X..X....................] duration: 6.590623328s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:38:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.590644178s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [....X..XX.XX.X....X.....XX......X...........X...........X...] duration: 39.748698138s trace: https://jaeger.dev.storj.io/trace/3b6f2c08b965e67 FAIL (2026-05-25 18:38:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 39.748718245s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 4.128928893s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:38:09 UTC) orbiter warning: context deadline exceeded Duration: 4.128950243s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [....X................X...............X..X...................] duration: 4.034796683s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:37:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.034819296s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 3.867165155s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:37:48 UTC) orbiter warning: context deadline exceeded Duration: 3.867177297s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 3.960165401s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:37:23 UTC) orbiter warning: context deadline exceeded Duration: 3.960178105s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [.....X..XX.XX.X....X.....XX......X...........X...........X..] duration: 26.227569009s trace: https://jaeger.dev.storj.io/trace/3b6f2c08b965e67 FAIL (2026-05-25 18:37:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 26.227583388s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.....X................X...............X..X..................] duration: 4.12623415s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:36:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.12626465s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 3.967834369s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:36:39 UTC) orbiter warning: context deadline exceeded Duration: 3.967854337s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [......X................X...............X..X.................] duration: 4.056594997s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:36:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.056621266s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 3.925514099s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:36:14 UTC) orbiter warning: context deadline exceeded Duration: 3.925533776s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [......X..XX.XX.X....X.....XX......X...........X...........X.] duration: 7.455126711s trace: https://jaeger.dev.storj.io/trace/3b6f2c08b965e67 FAIL (2026-05-25 18:36:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.455142009s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [X......X..XX.XX.X....X.....XX......X...........X...........X] duration: 1m0.001513361s trace: https://jaeger.dev.storj.io/trace/3b6f2c08b965e67 FAIL (2026-05-25 18:35:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001521707s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 3.901087169s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:35:32 UTC) orbiter warning: context deadline exceeded Duration: 3.901110674s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.......X................X...............X..X................] duration: 4.081084011s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:35:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.081100092s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 4.069469771s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:34:42 UTC) orbiter warning: context deadline exceeded Duration: 4.069480941s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [........X................X...............X..X...............] duration: 4.970591992s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:34:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.970672186s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.........X................X...............X..X..............] duration: 3.994015103s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:34:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.994037076s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [.X......X..XX.XX.X....X.....XX......X...........X...........] duration: 9.712142221s trace: https://jaeger.dev.storj.io/trace/40ae3f9d0b183cad FAIL (2026-05-25 18:34:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.712161088s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 3.903721407s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:33:40 UTC) orbiter warning: context deadline exceeded Duration: 3.903740993s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..........X................X...............X..X.............] duration: 3.937357347s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:33:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.937374179s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [..X......X..XX.XX.X....X.....XX......X...........X..........] duration: 30.760757735s trace: https://jaeger.dev.storj.io/trace/40ae3f9d0b183cad FAIL (2026-05-25 18:33:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.760778436s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 3.944371882s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:32:48 UTC) orbiter warning: context deadline exceeded Duration: 3.944417659s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...........X................X...............X..X............] duration: 4.03755539s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:32:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.037576509s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 3.966830753s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:32:01 UTC) orbiter warning: context deadline exceeded Duration: 3.966851212s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [...X......X..XX.XX.X....X.....XX......X...........X.........] duration: 7.854864677s trace: https://jaeger.dev.storj.io/trace/40ae3f9d0b183cad FAIL (2026-05-25 18:31:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.854887911s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 3.819792255s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:31:42 UTC) orbiter warning: context deadline exceeded Duration: 3.819815538s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [............X................X...............X..X...........] duration: 4.173883324s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:31:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.173895177s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.............X................X...............X..X..........] duration: 51.477876367s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:31:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 51.477889011s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 3.92793617s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:31:02 UTC) orbiter warning: context deadline exceeded Duration: 3.927949646s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [....X......X..XX.XX.X....X.....XX......X...........X........] duration: 6.859716013s trace: https://jaeger.dev.storj.io/trace/40ae3f9d0b183cad FAIL (2026-05-25 18:30:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.859735942s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [.....X......X..XX.XX.X....X.....XX......X...........X.......] duration: 10.98418184s trace: https://jaeger.dev.storj.io/trace/40ae3f9d0b183cad FAIL (2026-05-25 18:30:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.984196448s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 3.823173699s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:30:11 UTC) orbiter warning: context deadline exceeded Duration: 3.823197054s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [......X......X..XX.XX.X....X.....XX......X...........X......] duration: 27.685826938s trace: https://jaeger.dev.storj.io/trace/40ae3f9d0b183cad FAIL (2026-05-25 18:30:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 27.685840614s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..............X................X...............X..X.........] duration: 3.863559427s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:29:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.863585578s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 12 out of 60 is failed (threshold=3) [.......X......X..XX.XX.X....X.....XX......X...........X.....] duration: 57.174241961s trace: https://jaeger.dev.storj.io/trace/40ae3f9d0b183cad FAIL (2026-05-25 18:29:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 57.174262059s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...............X................X...............X..X........] duration: 4.031402436s trace: https://jaeger.dev.storj.io/trace/7a1964cec7dc06f1 FAIL (2026-05-25 18:29:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 77]: Uploading piece... May 25 18:20:50.088898735 (16h16m35.872238834s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089335718 (16h16m35.872675817s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.089738658 (16h16m35.873078747s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.090791806 (16h16m35.874131905s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091183283 (16h16m35.874523382s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091570923 (16h16m35.874911022s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.091882068 (16h16m35.875222157s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092229971 (16h16m35.87557007s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092535213 (16h16m35.875875312s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.092821670 (16h16m35.876161769s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093095122 (16h16m35.876435221s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093408419 (16h16m35.876748518s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.093697010 (16h16m35.877037099s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094006180 (16h16m35.877346269s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:50.094366327 (16h16m35.877706426s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Uploading piece... May 25 18:20:51.160092429 (16h16m36.943432528s) [upload=15577]: Next returned nil segment May 25 18:20:51.160103189 (16h16m36.943443289s) [upload=15577]: Waiting for error group managing segments... May 25 18:20:51.436752869 (16h16m37.220092968s) [noise=true , address=212.102.52.214:4349 , piece_id=DBHHZEZORY5EKZBXNPW6BVLBOERLSVWH6GAZI3PZP464KNW5IK4A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.442289854 (16h16m37.225629953s) [noise=true , address=212.102.52.214:4351 , piece_id=ZPCXDT73ZC7DNWXAPNRUO5I5X7BYE4XCFH6J7CTIC345L66MZW2Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.444314717 (16h16m37.227654816s) [noise=true , address=212.102.52.213:4340 , piece_id=TBYFRTU5DOYVVQCILUAXLSLGKMRK5E72BAXDVH42NEDNICPBTBJQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.445599629 (16h16m37.228939729s) [noise=true , address=212.102.52.213:4329 , piece_id=V3HGH6WYZRYGB44YVGP4XD6N3WVO6IXZMAMHXEB2ELIZTQVFY2NQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.447581912 (16h16m37.230922011s) [noise=true , address=212.102.52.215:4390 , piece_id=GMCYG3X4USPS6CN5LBBWNI72E4J6NANMNVBHHB6EU5VSNGN4ANPA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.449342581 (16h16m37.23268268s) [noise=true , address=212.102.52.213:4331 , piece_id=UOU2NUFCKKAPLSDQ5Z42QW6L6J26JDQNP4BHO6RVIGSUX5KFAXMA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452203890 (16h16m37.235543989s) [noise=true , address=212.102.52.217:4434 , piece_id=AVY3B2BLYQX2Y6TZKAT4EE3JKUMGXOOEB2OID5TFNLLRF3TAMXHA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.452335812 (16h16m37.235675901s) [noise=true , address=212.102.52.214:4352 , piece_id=CZEXVWWJWCU7PCK5SKECIR7454WEH2SEPSOG5REBPSCE54JKYOCQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.453015970 (16h16m37.236356069s) [noise=true , address=212.102.52.216:4415 , piece_id=YPZXUWZFCOKOOSOADH7E77L7VOUWIMETRPZA3UYKG5STTSDJHUGA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.454515381 (16h16m37.23785547s) [noise=true , address=212.102.52.217:4440 , piece_id=SPGQDY4LTBFXUSYYCBEZ7PQ7RX4XKJ3PV7QUUEGNFCHR5MBYB6JA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.455034050 (16h16m37.238374139s) [noise=true , address=212.102.52.217:4431 , piece_id=N7SFZMEZ32WJBLIMP6P65XGBHXKPMQKEDNAIGCWCYDDB5BIXSDKQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.458988927 (16h16m37.242329016s) [noise=true , address=212.102.52.215:4388 , piece_id=NP4T2SFOU75LVGCH3WTLIEXFT3JXMOU3CTD35UCMOAA6C5LU7AKA, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.463065876 (16h16m37.246405975s) [noise=true , address=212.102.52.216:4407 , piece_id=GD4J7IPAWBYUTLGDQUB4NKHBKGYWDSY2QCTWLJFUQ2QNUGENNJEQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.467219712 (16h16m37.250559811s) [noise=true , address=212.102.52.215:4371 , piece_id=DQYFDCO7THUTPBEPFDAVID3HCZRSYNMUE2KQMIH5SCHWDB6XT2FQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.468380286 (16h16m37.251720385s) [noise=true , address=212.102.52.216:4416 , piece_id=4ATUA7XKNNUEXT2MP6XIFLT2YOHVY3ZI3BP4JBSMR6PCTUDOBIDQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.471996817 (16h16m37.255336916s) [noise=true , address=212.102.52.217:4424 , piece_id=ZDOEQPYMSQFRT47B3FVE4H4RDBIS23TB2NUVNTHY3ZH4QXRKTZTQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: <nil> May 25 18:20:51.472006284 (16h16m37.255346373s) [seg_pos={0 0}, upload=15577]: Satisfied cohort requirements after 16 pieces May 25 18:20:51.472185516 (16h16m37.255525615s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472192570 (16h16m37.255532669s) [noise=true , address=212.102.52.213:4342 , piece_id=BBH62HWIL6PZXFMKJZKKSU6S5X3V2WYJTF4QQZEE2APRCTZTKP2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472198472 (16h16m37.255538581s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sH5EigMH2sodFcDBup4WLsKZ1jEvQXP9xRRV1HrCEvYCLBZHz): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472205916 (16h16m37.255546015s) [noise=true , address=212.102.52.216:4400 , piece_id=HB5UHZDAAHWHMTUUXI36ZXKIBT7ZULB4G66BHVJVJZPNS44TAG2A, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472316817 (16h16m37.255656906s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wAfNSuNAdVkfMjxBhTsxFpMrKVephQNoWmgtBu4fvUEmGrHtD): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472324592 (16h16m37.255664681s) [noise=true , address=212.102.52.215:4370 , piece_id=ILTJSKFAHMUCMELSCEJKW6SPTD2UTCVWFT5TCRSZFQFHX7ZYZI7Q, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472550994 (16h16m37.255891083s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BHBjpvr3Y4dyKi2KHFy7MpiPzh291UT6X1MMvQLB2ts4xpx6p): protocol: expected piece hash; context canceled; EOF May 25 18:20:51.472555211 (16h16m37.255895311s) [noise=true , address=212.102.52.214:4364 , piece_id=SILZOY3SW665BHP4LM7OEDRBUCAFDMCPCFUK7JH5WDNI5C2M3ECQ, seg_pos={0 0}, upload=15577]: Long tail cancellation due to optimal threshold May 25 18:20:51.472589939 (16h16m37.255930038s) [seg_pos={0 0}, upload=15577]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 18:20:51.472649642 (16h16m37.255989741s) [upload=15577]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 18:20:51.472654231 (16h16m37.25599433s) [upload=15577]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 18:22:06.057151580 (16h17m51.840491679s) [upload=15577]: Done uploading segments... May 25 18:22:06.057234688 (16h17m51.840574797s) [upload=15577]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.031415661s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 3.871380108s trace: https://jaeger.dev.storj.io/trace/14eb8131f680ed75 FAIL (2026-05-25 18:28:56 UTC) orbiter warning: context deadline exceeded Duration: 3.87140201s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 13 out of 60 is failed (threshold=3) [X.......X......X..XX.XX.X....X.....XX......X...........X....] duration: 47.185960933s trace: https://jaeger.dev.storj.io/trace/40ae3f9d0b183cad FAIL (2026-05-25 18:28:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 47.185972616s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 672.857651ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/7e710747942acdb2 FAIL (2026-05-25 18:28:22 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.4.32.59:443: i/o timeout Duration: 672.874083ms core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)