Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.494827888s trace:
https://jaeger.dev.storj.io/trace/41267ee1c5917b88
FAIL (2026-05-26 08:27:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ODQA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment
May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments...
May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces
May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments...
May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil>
Duration: 4.49485s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.073178642s trace:
https://jaeger.dev.storj.io/trace/41267ee1c5917b88
FAIL (2026-05-26 08:25:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ODQA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment
May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments...
May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces
May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments...
May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil>
Duration: 5.073197858s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.574250003s trace:
https://jaeger.dev.storj.io/trace/41267ee1c5917b88
FAIL (2026-05-26 08:24:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ODQA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment
May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments...
May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces
May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments...
May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil>
Duration: 5.574273708s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
4.099819121s trace:
https://jaeger.dev.storj.io/trace/41267ee1c5917b88
FAIL (2026-05-26 08:23:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ODQA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment
May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments...
May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces
May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments...
May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil>
Duration: 4.099843598s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
4.094910489s trace:
https://jaeger.dev.storj.io/trace/41267ee1c5917b88
FAIL (2026-05-26 08:22:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ODQA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment
May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments...
May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces
May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments...
May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil>
Duration: 4.094930006s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.064884679s trace:
https://jaeger.dev.storj.io/trace/41267ee1c5917b88
FAIL (2026-05-26 08:22:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ODQA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment
May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments...
May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces
May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments...
May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil>
Duration: 4.064908954s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.207108096s trace:
https://jaeger.dev.storj.io/trace/41267ee1c5917b88
FAIL (2026-05-26 08:21:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ODQA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment
May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments...
May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces
May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments...
May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil>
Duration: 4.20712609s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
21.247152498s trace:
https://jaeger.dev.storj.io/trace/41267ee1c5917b88
FAIL (2026-05-26 08:20:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ODQA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment
May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments...
May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces
May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments...
May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil>
Duration: 21.24716372s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.002406226s trace:
https://jaeger.dev.storj.io/trace/41267ee1c5917b88
FAIL (2026-05-26 08:20:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ODQA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237142543 (30h15m39.020482642s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.237784137 (30h15m39.021124226s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.238699074 (30h15m39.022039173s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239208736 (30h15m39.022548835s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.239525420 (30h15m39.022865519s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.240100958 (30h15m39.023441057s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241064877 (30h15m39.024404976s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241373797 (30h15m39.024713896s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.241720078 (30h15m39.025060177s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242524283 (30h15m39.025864382s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.242859873 (30h15m39.026199972s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.243174152 (30h15m39.026514251s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.247965354 (30h15m39.031305463s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.248997654 (30h15m39.032337753s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:53.250636280 (30h15m39.033976369s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Uploading piece...
May 26 08:19:54.311855370 (30h15m40.095195469s) [upload=28950]: Next returned nil segment
May 26 08:19:54.311866420 (30h15m40.095206519s) [upload=28950]: Waiting for error group managing segments...
May 26 08:19:54.598849599 (30h15m40.382189688s) [noise=true , address=212.102.52.215:4390 , piece_id=DZQSIGVYQQES2FZ3QMYYJQLMWI3F7CDDPUVH67LH2GUG77EBQFVA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.598906257 (30h15m40.382246356s) [noise=true , address=212.102.52.215:4386 , piece_id=273C4OZQV45HSNQ2BSWAANADZ3QIH2LSRSXHTLLZDAKA5GYAFF5A, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.599804782 (30h15m40.383144881s) [noise=true , address=212.102.52.217:4436 , piece_id=MO6PHCONCW2KKJODB3B5MSQK32C4HK746S4C63TRAIYBJKC3COLQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603648355 (30h15m40.386988454s) [noise=true , address=212.102.52.216:4398 , piece_id=MIXOV5LMX4PVTE2KT63XFXRGO2KE4GU326M22BHNNEHJ74E7RJ3Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.603893653 (30h15m40.387233752s) [noise=true , address=212.102.52.214:4345 , piece_id=EYKSITLN7HO23F556PHQKZVOVKDDGTYGFL6N5HFO2CGC4DPLRNPA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604570355 (30h15m40.387910454s) [noise=true , address=212.102.52.217:4431 , piece_id=B4UNVEZLNRH52SFWLZAEC64V26ARMYVCHJNCMABYZ55WRSFPVFGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.604878543 (30h15m40.388218642s) [noise=true , address=212.102.52.217:4428 , piece_id=U6UUW2GGTUXQQRPFY23LNUCUONAYFYZJ6T5L63XKKIJW3MVPODQA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.605288024 (30h15m40.388628123s) [noise=true , address=212.102.52.216:4393 , piece_id=3FBTFYOMNIWPYNJTMDPGRMMT6DVPVR5TDAQUOQPLEL3XWFJK5JMQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.607970061 (30h15m40.39131015s) [noise=true , address=212.102.52.213:4335 , piece_id=HNKUNQWNPRH52GRGQBBNJB4A3KMJXI5MCELRLXCZEGN2UP2SSP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.611711991 (30h15m40.39505209s) [noise=true , address=212.102.52.214:4358 , piece_id=5KJBB4I5J665TOZQNAT2RVK4EIZYNZ6N6BVHFMOKAWB4EW6KLU4Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.616604807 (30h15m40.399944906s) [noise=true , address=212.102.52.216:4404 , piece_id=4G76QW5JCSR73AEAAHYPC5ORFN33D23IMYPZSQ2A7JQX373TB4MQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.619400832 (30h15m40.402740931s) [noise=true , address=212.102.52.213:4343 , piece_id=QPVII7OZAD2CSARGJHLVMIXA255XFAJQSQ7Z23ZHHQBNV5CNKP2Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.621930949 (30h15m40.405271038s) [noise=true , address=212.102.52.215:4378 , piece_id=LSRLYGQQLX5WKSVRHK3QII4O5IPNZWQHTEZA45ZL5EUUDLSGSCZQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.623459225 (30h15m40.406799324s) [noise=true , address=212.102.52.214:4364 , piece_id=O5T5BBFQCOQCFRFNAESKDVTEVINZ7B77LEEZOM6GSFUO4SKAWTYA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.686303906 (30h15m40.469644005s) [noise=true , address=212.102.52.216:4415 , piece_id=MFEIC5ZYEKGCBKSBCQS2HRGCJTKFQTWNGP4UKB4YFCMPIFYQXNCQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688055278 (30h15m40.471395377s) [noise=true , address=212.102.52.213:4322 , piece_id=T472EANH63YUS2RQ5A6UIP5AEMNXW4ETTBWAVPYKBVDAJJRA4RGA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: <nil>
May 26 08:19:54.688073253 (30h15m40.471413352s) [seg_pos={0 0}, upload=28950]: Satisfied cohort requirements after 16 pieces
May 26 08:19:54.688273684 (30h15m40.471613784s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688283604 (30h15m40.471623703s) [noise=true , address=212.102.52.214:4367 , piece_id=2D6SWCWKSKMYUT5SWPGUW5HJM7A6U6QWPGB3ZGUPIX242VICPMVQ, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688311457 (30h15m40.471651546s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hcqjV6TvZLc1B2EKCUncpMAvMAt6Yroqta5rQiXBWeMZwCRkC): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688332256 (30h15m40.471672355s) [noise=true , address=212.102.52.215:4380 , piece_id=ICGV7K5O4IKZN73G25WHULXMH5YDQSPIVNHUO6I6HVWMAY3VW4EA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688427579 (30h15m40.471767668s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688432458 (30h15m40.471772557s) [noise=true , address=212.102.52.213:4326 , piece_id=XHAWDFOH4ZXKH7CN36D76TFNR7NFEWU3N73IWBG6Z6JCURTEFA6Q, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688520256 (30h15m40.471860355s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12anTnZiYrLfiTtgB9XwUnpfrRGM1GJMLFkRKbEza7DWXZgeDqZ): protocol: expected piece hash; context canceled; EOF
May 26 08:19:54.688524995 (30h15m40.471865094s) [noise=true , address=212.102.52.217:4439 , piece_id=IHA4G7MWGWXQYVPDM2A3UFCJHGARTLTZ66IGLPPIDAU7XEBUVMJA, seg_pos={0 0}, upload=28950]: Long tail cancellation due to optimal threshold
May 26 08:19:54.688551746 (30h15m40.471891845s) [seg_pos={0 0}, upload=28950]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil>
May 26 08:19:54.688624124 (30h15m40.471964223s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 26 08:19:54.688632038 (30h15m40.471972137s) [upload=28950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 26 08:20:14.828029898 (30h16m0.611369997s) [upload=28950]: Done uploading segments...
May 26 08:20:14.828043134 (30h16m0.611383233s) [upload=28950]: Upload finished. err: <nil>
Duration: 1m0.002428469s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
3.720333636s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:26:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.720348696s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
3.811403982s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:25:38 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.811430442s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
3.92449839s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:24:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.924517005s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
4.013924824s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:24:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 4.013958278s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
4.928369694s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:23:55 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 4.928390666s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
3.884664102s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:22:40 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.884686215s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
3.828031444s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:22:00 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.828060471s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
3.731714557s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:20:47 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.731727741s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
3.729744731s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:19:38 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.729791519s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
3.768487084s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:18:34 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.768514666s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
3.689943258s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:18:00 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.689972655s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
3.59059423s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:17:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.590615241s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
3.782644387s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:16:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.782665728s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
3.936802645s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:16:04 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.936823684s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
3.691408458s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:15:09 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.691427143s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
3.710821946s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:14:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.710842225s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
3.7243041s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:13:56 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.724321074s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
3.880329951s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:13:06 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.880352103s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
3.921721524s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:12:18 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.921741181s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
3.766498577s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:11:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.76654719s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
3.789420233s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:11:05 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.78945604s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
3.880218954s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:09:55 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.880280891s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
3.795347823s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:09:00 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.795370055s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
3.921663766s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:08:29 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.921684134s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
3.772802485s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:07:14 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.772829857s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
3.774745634s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:06:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.77476975s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
3.762882929s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:05:39 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.762903557s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
3.746176879s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:04:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.746200655s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
3.888375064s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:03:30 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.888418678s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
3.880606897s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:02:45 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.880626453s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
4.877847865s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:02:12 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 4.877869916s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
3.826720252s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:01:12 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.82674438s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
3.859666975s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 06:00:45 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.859686813s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
3.729342405s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:59:42 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.729363235s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
3.854024571s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:58:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.854085267s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
3.822394767s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:57:47 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.822417831s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
3.715103117s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:57:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.715123625s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................X......................] duration:
3.814739808s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:55:51 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.814763112s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................X.....................] duration:
3.912774296s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:55:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.912796889s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................X....................] duration:
4.756573416s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:54:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 4.756593857s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................] duration:
3.800387404s trace:
https://jaeger.dev.storj.io/trace/1e7b4f4d2859efa6
FAIL (2026-05-26 05:53:05 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 3.800408363s
core
uplink
us-select-1
us1-placement-20
|