Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X....................X] duration: 30.001223486s trace: https://jaeger.dev.storj.io/trace/4bc69f554cccc48f FAIL (2026-01-13 09:44:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001237001s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001060262s trace: https://jaeger.dev.storj.io/trace/4226536f67e7860 FAIL (2026-01-13 09:44:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001089446s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000820727s trace: https://jaeger.dev.storj.io/trace/380b3aa74425f9dc FAIL (2026-01-13 09:43:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00088572s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 27.875131235s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:43:41 UTC) orbiter warning: context deadline exceeded Duration: 27.87515456s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.743701359s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:43:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.743733982s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001418866s trace: https://jaeger.dev.storj.io/trace/2c7e760b167c3510 FAIL (2026-01-13 09:43:25 UTC) orbiter warning: context deadline exceeded Duration: 5.001442031s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.00218627s trace: https://jaeger.dev.storj.io/trace/69989b00f06525e4 FAIL (2026-01-13 09:42:50 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.002210848s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 20.01492316s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:42:48 UTC) orbiter warning: context deadline exceeded Duration: 20.014951153s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.727463921s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:42:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.72748948s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001603309s trace: https://jaeger.dev.storj.io/trace/4c94090ae894d67e FAIL (2026-01-13 09:42:01 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001628578s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 22.460863953s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:41:59 UTC) orbiter warning: context deadline exceeded Duration: 22.460887967s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.837579011s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:41:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.837598087s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001462196s trace: https://jaeger.dev.storj.io/trace/d5db84d0da99f60 FAIL (2026-01-13 09:41:25 UTC) orbiter warning: context deadline exceeded Duration: 5.001483916s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 25.813285752s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:41:21 UTC) orbiter warning: context deadline exceeded Duration: 25.813336217s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.755990439s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:41:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.756022359s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.738839109s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:40:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.738864267s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 30.001784866s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:40:45 UTC) orbiter warning: context deadline exceeded Duration: 30.001812379s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [.XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001491359s trace: https://jaeger.dev.storj.io/trace/1ae017c0dbf6ba3 FAIL (2026-01-13 09:40:14 UTC) orbiter warning: context deadline exceeded Duration: 5.001519823s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.845329446s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:40:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.845361587s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 26.277331313s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:40:06 UTC) orbiter warning: context deadline exceeded Duration: 26.277381268s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.837619563s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:39:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.837646262s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 25.726377689s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:39:13 UTC) orbiter warning: context deadline exceeded Duration: 25.726389492s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 57 out of 60 is failed (threshold=6) [..XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001744288s trace: https://jaeger.dev.storj.io/trace/7200c31250f92f9c FAIL (2026-01-13 09:39:01 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001767142s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 25.041341191s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:38:47 UTC) orbiter warning: context deadline exceeded Duration: 25.041368052s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 57 out of 60 is failed (threshold=6) [X..XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001178674s trace: https://jaeger.dev.storj.io/trace/6934aa9fc987459d FAIL (2026-01-13 09:38:40 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001201847s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.730727891s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:38:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.730758179s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 26.705306488s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:38:01 UTC) orbiter warning: context deadline exceeded Duration: 26.70533361s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.732951324s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:37:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.732986221s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 57 out of 60 is failed (threshold=6) [XX..XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001412545s trace: https://jaeger.dev.storj.io/trace/29f7bec6ea813fc4 FAIL (2026-01-13 09:37:35 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001436009s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 23.686015889s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:37:25 UTC) orbiter warning: context deadline exceeded Duration: 23.686128422s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.735073151s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:36:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.735091426s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [.XX..XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001582329s trace: https://jaeger.dev.storj.io/trace/120d2c4d8173dcc2 FAIL (2026-01-13 09:36:50 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001643496s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 20.521337567s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:36:18 UTC) orbiter warning: context deadline exceeded Duration: 20.521372513s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.802679252s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:35:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.80273041s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [X.XX..XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000935569s trace: https://jaeger.dev.storj.io/trace/5d958a611115de8 FAIL (2026-01-13 09:35:42 UTC) orbiter warning: context deadline exceeded Duration: 5.000957891s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 19.461535925s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:35:33 UTC) orbiter warning: context deadline exceeded Duration: 19.461605639s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.800168301s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:35:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.80019902s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 27.365665156s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:34:47 UTC) orbiter warning: context deadline exceeded Duration: 27.365689933s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XX.XX..XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001344617s trace: https://jaeger.dev.storj.io/trace/1c1ea5f7e15f2848 FAIL (2026-01-13 09:34:46 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001386446s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.771027052s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:34:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.771049805s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXX.XX..XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000796794s trace: https://jaeger.dev.storj.io/trace/76b84ff591f2bf57 FAIL (2026-01-13 09:34:09 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000817473s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.766303822s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:33:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.766334689s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 18.287001815s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:33:34 UTC) orbiter warning: context deadline exceeded Duration: 18.287028366s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXX.XX..XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001391036s trace: https://jaeger.dev.storj.io/trace/20eda3b7a09aebae FAIL (2026-01-13 09:33:04 UTC) orbiter warning: context deadline exceeded Duration: 5.001415282s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.732782564s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:32:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.732810308s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 24.273315824s trace: https://jaeger.dev.storj.io/trace/7ee725d77672c862 FAIL (2026-01-13 09:32:26 UTC) orbiter warning: context deadline exceeded Duration: 24.273366431s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 56 out of 60 is failed (threshold=6) [XXXXX.XX..XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXX] duration: 5.002026466s trace: https://jaeger.dev.storj.io/trace/6bb6b030cd81f614 FAIL (2026-01-13 09:32:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.002053018s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 13.960006439s trace: https://jaeger.dev.storj.io/trace/2d6d83a05cd3ec60 FAIL (2026-01-13 09:32:04 UTC) orbiter warning: context deadline exceeded Duration: 13.960031075s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.744567931s trace: https://jaeger.dev.storj.io/trace/209f6f5543c7dce4 FAIL (2026-01-13 09:31:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, Piece ID: NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ) context deadline exceeded; piecestore: (Node ID: 12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, Piece ID: 3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ) context deadline exceeded; piecestore: (Node ID: 12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, Piece ID: LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ) context deadline exceeded ======LOGS====== ent. Inline: false Jan 13 09:28:06.315478350 (929h59m6.186561385s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 13 09:28:06.315483540 (929h59m6.186566575s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 09:28:09.241621500 (929h59m9.112704545s) [seg_pos={0 0}, upload=813972]: Begin upload segment... Jan 13 09:28:09.241671425 (929h59m9.11275446s) [seg_pos={0 0}, upload=813972]: Done begin upload segment. Jan 13 09:28:09.241703947 (929h59m9.112786992s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.241712664 (929h59m9.112795699s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242438585 (929h59m9.11352162s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.242727556 (929h59m9.113810591s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243047555 (929h59m9.1141306s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243340904 (929h59m9.114423939s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.243735925 (929h59m9.11481897s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.244030276 (929h59m9.115113312s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.245863306 (929h59m9.116946341s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.247027153 (929h59m9.118110188s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.248440564 (929h59m9.119523619s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.249844076 (929h59m9.120927121s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.251275041 (929h59m9.122358076s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.252655870 (929h59m9.123738915s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.253473537 (929h59m9.124556582s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:09.254758193 (929h59m9.125841238s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Uploading piece... Jan 13 09:28:11.087868620 (929h59m10.958951665s) [upload=813972]: Next returned nil segment Jan 13 09:28:11.087884400 (929h59m10.958967435s) [upload=813972]: Waiting for error group managing segments... Jan 13 09:28:11.388729734 (929h59m11.259812799s) [noise=true , address=145.79.227.50:4373 , piece_id=R5A7RCLHAH3ODMP563M27O6T7ZNACL36HJJOFVLRHYG456XUXXBA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.399388468 (929h59m11.270471504s) [noise=true , address=145.79.227.21:4473 , piece_id=FHOGGYMZY7DU6T7FUFNALWHI4Y6SDMPYF242QLW7C4UZIKKXEJ3A, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.405180828 (929h59m11.276263873s) [noise=true , address=145.79.227.13:4803 , piece_id=DNNAZPZ2TYQI6VCXNIZKSMU5VQCXKEDN3L6K6MHSVNRN3R246BCQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.423915039 (929h59m11.294998074s) [noise=true , address=145.79.227.31:4799 , piece_id=NOBWZTUK4VDKXM3PCO3Y623KIW2XKFRZXWZEDFVVRT5JHTPCZZQQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.425205065 (929h59m11.29628811s) [noise=true , address=145.79.227.48:4301 , piece_id=BIBJBBTITB6AA2SWXXZAIEOOAIARHUIVCBXHB4JXMUSELMZSLLTA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.427897582 (929h59m11.298980617s) [noise=true , address=145.79.227.5:4221 , piece_id=MAYWAFPWGGY6OJMP2OPGXJ4CFWMHIOL32IDBYGFVIONN6PFRDK2Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.461421214 (929h59m11.332504249s) [noise=true , address=145.79.227.2:4113 , piece_id=KUG2JKJTNJWMTZAP5F4HGA2UEKRHORRYVFKQ2FAX4KLQDVEX7UYQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.466681119 (929h59m11.337764154s) [noise=true , address=145.79.227.37:4566 , piece_id=NHE62LRK3ZLPFLQXOIPJZ3LB47RSNU7L2C3DGJKZYV3EXLYBSN6Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.468074292 (929h59m11.339157327s) [noise=true , address=145.79.227.11:4732 , piece_id=ZNFPDXJOGVKRQHPN66JHECSZLNEQ57MVWX4GAA6ETQSCNWCJQ75Q, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.472717633 (929h59m11.343800668s) [noise=true , address=145.79.227.35:4483 , piece_id=PH7UUSSVGW3I2KXRBDWEIFHDL3SC63SYDUPWMKG3NX3HKG6E3OYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.502968303 (929h59m11.374051338s) [noise=true , address=145.79.227.7:4293 , piece_id=LTQ6DD2KQ55UCWIJ43SWJO7Q5IDDJFTSD2Z7SVMHR2HLUOUSBNDQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.554022174 (929h59m11.425105219s) [noise=true , address=145.79.227.51:4409 , piece_id=3FOIHL6K6JAEDPWIRHT7IJOQ534UUKYAVCNAW4V3R5QL3D25UKAA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585092324 (929h59m11.456175369s) [noise=true , address=145.79.227.47:4267 , piece_id=RB3RDZAJRF3VV6LL6LUI5544BM7MFTGUIQ64Y4G23FHFRIYWZNUA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: <nil> Jan 13 09:28:11.585114155 (929h59m11.4561972s) [seg_pos={0 0}, upload=813972]: Segment reached optimal threshold of 13 pieces. Jan 13 09:28:11.585293828 (929h59m11.456376863s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP): protocol: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44548->145.79.227.52:4447: use of closed network connection Jan 13 09:28:11.585299989 (929h59m11.456383025s) [noise=true , address=145.79.227.52:4447 , piece_id=ZZMECYYJKEXTVZI6WQVEMT23OAVZ7SILIHSSE2OHFKSESUAQHJRQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585433102 (929h59m11.456516137s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK): protocol: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52450->145.79.227.6:4257: use of closed network connection Jan 13 09:28:11.585440497 (929h59m11.456523532s) [noise=true , address=145.79.227.6:4257 , piece_id=7NPEYE7VHKUHSOYCDOUVMN2HBL4JEXAGZS64K7M6L6DDIIF755TQ, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585617424 (929h59m11.456700469s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:49630->145.79.227.49:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 13 09:28:11.585629516 (929h59m11.456712562s) [noise=true , address=145.79.227.49:4337 , piece_id=ZRIX2M4OOA6LKJ6FJ2JORHE4XZQDJRG3KSBUNRJ3EEEXMIK5VMYA, seg_pos={0 0}, upload=813972]: Long tail cancellation due to optimal threshold Jan 13 09:28:11.585663561 (929h59m11.456746596s) [seg_pos={0 0}, upload=813972]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 09:28:11.585783911 (929h59m11.456866946s) [upload=813972]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 09:28:11.585791646 (929h59m11.456874681s) [upload=813972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 09:28:11.889773771 (929h59m11.760856816s) [upload=813972]: Done uploading segments... Jan 13 09:28:11.889820049 (929h59m11.760903094s) [upload=813972]: Upload finished. err: <nil> Duration: 5.744594281s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 23.717743175s trace: https://jaeger.dev.storj.io/trace/2d6d83a05cd3ec60 FAIL (2026-01-13 09:31:33 UTC) orbiter warning: context deadline exceeded Duration: 23.717770446s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)