Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [X.X.XX.....................X.......X..........X.......X.....] duration: 3.635979793s trace: https://jaeger.dev.storj.io/trace/74da1242d189ceaf FAIL (2025-12-09 05:35:45 UTC) orbiter warning: context deadline exceeded Duration: 3.636005752s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.224065236s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:35:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.224098079s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.698467512s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:35:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.69850271s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.040978774s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:35:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.041009664s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.022252014s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:35:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.022438268s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.674107235s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:35:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.674126363s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [.X.X.XX.....................X.......X..........X.......X....] duration: 3.573645426s trace: https://jaeger.dev.storj.io/trace/74da1242d189ceaf FAIL (2025-12-09 05:35:09 UTC) orbiter warning: context deadline exceeded Duration: 3.573685171s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.032362023s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:34:54 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.032390627s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.059590734s trace: https://jaeger.dev.storj.io/trace/2127b89fc0dfe472 FAIL (2025-12-09 05:34:52 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.059611944s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [..X.X.XX.....................X.......X..........X.......X...] duration: 3.628305498s trace: https://jaeger.dev.storj.io/trace/74da1242d189ceaf FAIL (2025-12-09 05:34:51 UTC) orbiter warning: context deadline exceeded Duration: 3.628356255s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.060827147s trace: https://jaeger.dev.storj.io/trace/2127b89fc0dfe472 FAIL (2025-12-09 05:34:07 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.060862554s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.987621038s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:34:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.987650875s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.009608206s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:34:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.009637813s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.09569348s trace: https://jaeger.dev.storj.io/trace/2127b89fc0dfe472 FAIL (2025-12-09 05:33:51 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.095810102s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.799176501s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:33:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.799210957s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [...X.X.XX.....................X.......X..........X.......X..] duration: 3.52074931s trace: https://jaeger.dev.storj.io/trace/74da1242d189ceaf FAIL (2025-12-09 05:33:40 UTC) orbiter warning: context deadline exceeded Duration: 3.520780368s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.82577767s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:33:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.825808827s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.70622673s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:33:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.706255966s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.92510625s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:32:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.925135777s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.059511082s trace: https://jaeger.dev.storj.io/trace/2127b89fc0dfe472 FAIL (2025-12-09 05:32:54 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.05954145s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [....X.X.XX.....................X.......X..........X.......X.] duration: 3.41076374s trace: https://jaeger.dev.storj.io/trace/74da1242d189ceaf FAIL (2025-12-09 05:32:44 UTC) orbiter warning: context deadline exceeded Duration: 3.410809055s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.759083613s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:32:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.759111926s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.766816525s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:32:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.767003982s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.297880115s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:32:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.297914761s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.066068835s trace: https://jaeger.dev.storj.io/trace/2127b89fc0dfe472 FAIL (2025-12-09 05:32:04 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.066104593s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.700275143s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:32:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.700332914s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 8 out of 60 is failed (threshold=6) [.....X.X.XX.....................X.......X..........X.......X] duration: 5.001175963s trace: https://jaeger.dev.storj.io/trace/74da1242d189ceaf FAIL (2025-12-09 05:31:55 UTC) orbiter warning: context deadline exceeded Duration: 5.001198564s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.007015782s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:31:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.007033796s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.95915766s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:31:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.959229156s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.721802308s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:31:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.721833537s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.009772862s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:31:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.009812379s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.78433373s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:31:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.784359209s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 7 out of 60 is failed (threshold=6) [......X.X.XX.....................X.......X..........X.......] duration: 3.471718488s trace: https://jaeger.dev.storj.io/trace/59c9d25cc6f80eab FAIL (2025-12-09 05:31:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.471742594s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.013543973s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:31:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.013576194s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.010868424s trace: https://jaeger.dev.storj.io/trace/2127b89fc0dfe472 FAIL (2025-12-09 05:31:00 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.010892471s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.8424097s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:30:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.842461609s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.799334417s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:30:29 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.79936208s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.775894332s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:30:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.775932103s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 7 out of 60 is failed (threshold=6) [.......X.X.XX.....................X.......X..........X......] duration: 3.479742228s trace: https://jaeger.dev.storj.io/trace/59c9d25cc6f80eab FAIL (2025-12-09 05:30:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.47976411s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.876364329s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:30:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.876392933s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.016254636s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:29:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.016286387s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.069773566s trace: https://jaeger.dev.storj.io/trace/2127b89fc0dfe472 FAIL (2025-12-09 05:29:46 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.06986032s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.735316811s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:29:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.735352758s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.902230477s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:29:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.902282516s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 7 out of 60 is failed (threshold=6) [........X.X.XX.....................X.......X..........X.....] duration: 3.463900482s trace: https://jaeger.dev.storj.io/trace/59c9d25cc6f80eab FAIL (2025-12-09 05:29:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.463925839s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.715556214s trace: https://jaeger.dev.storj.io/trace/56a3475297485c08 FAIL (2025-12-09 05:29:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== X5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065270864 (85h22m45.936353909s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.065752381 (85h22m45.936835426s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066247914 (85h22m45.937330959s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.066774447 (85h22m45.937857532s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067303855 (85h22m45.938386891s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.067822694 (85h22m45.938905739s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068333786 (85h22m45.939416881s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.068849508 (85h22m45.939932543s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.069469499 (85h22m45.940552544s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.072036628 (85h22m45.943119673s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Uploading piece... Dec 9 04:51:46.888693467 (85h22m46.759776502s) [upload=74556]: Next returned nil segment Dec 9 04:51:46.888707253 (85h22m46.759790288s) [upload=74556]: Waiting for error group managing segments... Dec 9 04:51:47.279773158 (85h22m47.150856203s) [noise=true , address=185.167.204.205:4020 , piece_id=3BUJEVVGL6UH65INUWX27BD5FGW6MB6DJ5SSBACQ4D5RQOHKT5BA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.282474582 (85h22m47.153557617s) [noise=true , address=185.167.204.205:4034 , piece_id=FTR5MFLENHZTTEW6L7NWFDIJGPTAZGWU6GP4DDDQDZK35ZGSCADA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.287117565 (85h22m47.15820061s) [noise=true , address=185.167.204.205:4007 , piece_id=GKRAWJPU5XDYMPPGHZOSOCF54MITRSUEZRWKYSGHFEJF2TC7YN6Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.288297912 (85h22m47.159380957s) [noise=true , address=185.167.204.206:4061 , piece_id=VUL4OSL3BTKXWWMZZ26JLOVTQ2BMQACPGBWHGP247C5AKGJS3HTA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289440658 (85h22m47.160523693s) [noise=true , address=185.167.204.206:4037 , piece_id=XGONHPKOKCPYQZATQY3Z4U2ZNNBV7YE2JRX5FF3ZCFHQEZBV7XSA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.289851421 (85h22m47.160934476s) [noise=true , address=185.167.204.205:4023 , piece_id=KL24TWTNUAJJALRGBH4KMEPC6PYGV7ONVN5LV64JD2V5PAR5D6CQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.290269507 (85h22m47.161352552s) [noise=true , address=185.167.204.205:4035 , piece_id=QOB3YZQVM3V4BGQWAMWLCGADGOB5Z7RDFGTB63SQGPNO25RGMIRA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.295536938 (85h22m47.166619983s) [noise=true , address=185.167.204.205:4009 , piece_id=TPSFBANPH3QMOETHSFBYIFKK3TTXNLLTK3EBUWD22EBWKTMZW6HQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300739596 (85h22m47.171822631s) [noise=true , address=185.167.204.205:4014 , piece_id=SKRUXMC2TQMNEZ6CYBZVMLYNB4K3X452W7M7EGVVFFSTOITCP3KA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.300896534 (85h22m47.171979579s) [noise=true , address=185.167.204.205:4010 , piece_id=RS6DJ2OJMOYHRJKERWHGGROKFV73RFFXJBM7PUXUKG5VOVQOGBPQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.303634699 (85h22m47.174717744s) [noise=true , address=185.167.204.206:4039 , piece_id=3OOA4F22GJOWTNXBJL34PZKL5BA372E4IEDFZEDXIAYB7LQFY2AA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.304032196 (85h22m47.175115241s) [noise=true , address=185.167.204.205:4011 , piece_id=J2YM4SX5MQXVPLTKCUWJQD3BNTQCJ3HZD667DRS6HKFVNY4OEWQQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.847206642 (85h22m47.718289677s) [noise=true , address=81.171.14.70:4025 , piece_id=NJUWMN24CHGRWP4OS2CPUW4HMYQK7VJYGE3GBRDRDZK76PSBT3KQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.878231424 (85h22m47.749314469s) [noise=true , address=81.171.14.70:4027 , piece_id=2YW52FPZHNG3TGLT32NSJDMRN2ZPTDID44U7BV73DPYHIGTLDWHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.913929187 (85h22m47.785012232s) [noise=true , address=81.171.14.70:4038 , piece_id=I3NZYZNGGEBDLOF5AW2WNFHAA3BDFIN3XREIZAV6W4R3UJ2KAOHQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:47.979060731 (85h22m47.850143776s) [noise=true , address=81.171.14.70:4046 , piece_id=7KWFQRAUKO2AQAPOVNM4FFZBKK3BITP7AGA4QBZ7T3SPXJVTVPEQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.290181480 (85h22m48.161264545s) [noise=true , address=81.171.14.70:4026 , piece_id=2SD4KRFMZ6VOLCIWFEMETCYLDX7GJZ5UYWO2VTWT3SLV47IWMIUA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.348307143 (85h22m48.219390188s) [noise=true , address=81.171.14.70:4036 , piece_id=CDLBWGBE7H66MYAFEG2SYVALAAWRZK5IBPLYWRQOEPOBYCQ3YHAA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.400755824 (85h22m48.27183886s) [noise=true , address=81.171.14.70:4042 , piece_id=YES6SNMMWSPGOJ6BBMYCFLLQS4EWEW22G52DAMPRIKBNJZESXP3Q, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.533382936 (85h22m48.404465981s) [noise=true , address=89.149.201.147:4004 , piece_id=CCCMJCLKJWELUFRR7M74HQ2C5AJDUZQNKCK54QMQUHEFWKY3T46A, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.553385017 (85h22m48.424468052s) [noise=true , address=89.149.201.147:4021 , piece_id=74TPYB6LHKHFF6K5QD6B5HQNMXGUY5A7UO6TRXWGDTKBUMTFC7JQ, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.554766448 (85h22m48.425849483s) [noise=true , address=89.149.201.147:4016 , piece_id=7HGY5QZTO35LFESAPMT4VSSHOM65KDIW3MZJLZ42C5OBK22U4STA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.567049941 (85h22m48.438132986s) [noise=true , address=89.149.201.147:4009 , piece_id=D6CNWDB4I5X64SCJ74KWYDZH4XXGDI3GVSL6NXHZWMSH6EJN3QJA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.609431201 (85h22m48.480514246s) [noise=true , address=89.149.201.147:4005 , piece_id=IX6QMA7PZSNDM535TNPWI4S5OMHPF4NAKEY3SEMZOZTJDYCYRTPA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.946626053 (85h22m48.817709098s) [noise=true , address=89.149.201.147:4002 , piece_id=SAENLJHQ4VDGI66VIAPRYGICLC6YUJWQYGDXY7OGOTLFGE2E6KFA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979683347 (85h22m48.850766393s) [noise=true , address=89.149.201.147:4013 , piece_id=LYQZQTEIZIFJC7R5WXXLBREQ4VIN5MQRKZRW4FJ42WI62WKMDNYA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: <nil> Dec 9 04:51:48.979705049 (85h22m48.850788094s) [seg_pos={0 0}, upload=74556]: Segment reached optimal threshold of 26 pieces. Dec 9 04:51:48.979913476 (85h22m48.850996511s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.979921591 (85h22m48.851004636s) [noise=true , address=89.149.201.147:4007 , piece_id=TD6VZFCIEFULPTYHOEYJS5BQM2BIP4IG4UUU5L7OITHQQSWWTGHA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980162019 (85h22m48.851245064s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF Dec 9 04:51:48.980173240 (85h22m48.851256285s) [noise=true , address=89.149.201.147:4023 , piece_id=MSQYWELFCDSYKRTQGD66X3IEKPLHGVO3SAXAOTNUO2GBP2GBVASA, seg_pos={0 0}, upload=74556]: Long tail cancellation due to optimal threshold Dec 9 04:51:48.980194180 (85h22m48.851277216s) [seg_pos={0 0}, upload=74556]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 04:51:48.980337884 (85h22m48.851420929s) [upload=74556]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 04:51:48.980346260 (85h22m48.851429295s) [upload=74556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 04:53:36.645778379 (85h24m36.516861414s) [upload=74556]: Done uploading segments... Dec 9 04:53:36.645916613 (85h24m36.516999678s) [upload=74556]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.715600177s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.792603478s trace: https://jaeger.dev.storj.io/trace/2f7262602a7ba484 FAIL (2025-12-09 05:28:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.792636901s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.674178791s trace: https://jaeger.dev.storj.io/trace/7f5385cb64fb69 FAIL (2025-12-09 05:28:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.674202036s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.061324354s trace: https://jaeger.dev.storj.io/trace/2127b89fc0dfe472 FAIL (2025-12-09 05:28:39 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.061357198s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 7 out of 60 is failed (threshold=6) [.........X.X.XX.....................X.......X..........X....] duration: 3.50790775s trace: https://jaeger.dev.storj.io/trace/59c9d25cc6f80eab FAIL (2025-12-09 05:28:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.507934081s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)