Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.619298561s trace: https://jaeger.dev.storj.io/trace/327d8af62af2ad4a FAIL (2025-12-08 05:26:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 04:41:10.986572683 (61h12m10.857655728s) [upload=53698]: Starting upload Dec 8 04:41:10.986697500 (61h12m10.857780545s) [upload=53698]: Done starting upload Dec 8 04:41:10.986782503 (61h12m10.857865538s) [upload=53698]: Uploading segments... Dec 8 04:41:10.987063708 (61h12m10.858146753s) [upload=53698]: Got next segment. Inline: false Dec 8 04:41:10.987116498 (61h12m10.858199543s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 04:41:10.987121758 (61h12m10.858204803s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 04:41:17.462876699 (61h12m17.333959744s) [seg_pos={0 0}, upload=53698]: Begin upload segment... Dec 8 04:41:17.462933336 (61h12m17.334016381s) [seg_pos={0 0}, upload=53698]: Done begin upload segment. Dec 8 04:41:17.462963864 (61h12m17.334046909s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464241417 (61h12m17.335324452s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464758772 (61h12m17.335841817s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465245028 (61h12m17.336328063s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465727617 (61h12m17.336810672s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.466300738 (61h12m17.337383783s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.467904602 (61h12m17.338987647s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.469643584 (61h12m17.340726629s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.470720414 (61h12m17.341803449s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.472841653 (61h12m17.343924708s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.474783842 (61h12m17.345866877s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.478925869 (61h12m17.350008904s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.482146932 (61h12m17.353229977s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.484118316 (61h12m17.355201361s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.486216912 (61h12m17.357299957s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.487427918 (61h12m17.358510953s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:19.196950317 (61h12m19.068033352s) [upload=53698]: Next returned nil segment Dec 8 04:41:19.196972289 (61h12m19.068055324s) [upload=53698]: Waiting for error group managing segments... Dec 8 04:41:19.470957375 (61h12m19.34204042s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.478965694 (61h12m19.350048739s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.488459723 (61h12m19.359542758s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.491834840 (61h12m19.362917885s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.496467461 (61h12m19.367550506s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.497643140 (61h12m19.368726185s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.513620774 (61h12m19.384703809s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.519169180 (61h12m19.390252225s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.582513759 (61h12m19.453596794s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.600844513 (61h12m19.471927549s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.627512986 (61h12m19.498596031s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.923827261 (61h12m19.794910306s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940676124 (61h12m19.811759159s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940696483 (61h12m19.811779518s) [seg_pos={0 0}, upload=53698]: Segment reached optimal threshold of 13 pieces. Dec 8 04:41:19.940920650 (61h12m19.812003695s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.940927292 (61h12m19.812010347s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941137082 (61h12m19.812220117s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941146079 (61h12m19.812229124s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941154806 (61h12m19.812237851s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a9UG3xktEYLqGrk6Z1YRdzSd7EF8CpjJFLdLHi46PUXS92rSg): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941162220 (61h12m19.812245255s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941203298 (61h12m19.812286343s) [seg_pos={0 0}, upload=53698]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 04:41:19.941272510 (61h12m19.812355555s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 04:41:19.941277359 (61h12m19.812360404s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 04:50:23.376780170 (61h21m23.247863205s) [upload=53698]: Done uploading segments... Dec 8 04:50:23.376921268 (61h21m23.248004313s) [upload=53698]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.619327727s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 4.972690645s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:26:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.97271934s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 490.298283ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/17143a9730f83ede FAIL (2025-12-08 05:26:01 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 490.332497ms core satellite eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................X...X..X..............................] duration: 5.980991694s trace: https://jaeger.dev.storj.io/trace/dc88131578b4b73 FAIL (2025-12-08 05:25:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.981016763s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.679608253s trace: https://jaeger.dev.storj.io/trace/56ba3625fd29e75 FAIL (2025-12-08 05:25:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 05:00:42.944581611 (61h31m42.815664646s) [upload=53967]: Starting upload Dec 8 05:00:42.944670691 (61h31m42.815753736s) [upload=53967]: Done starting upload Dec 8 05:00:42.944716888 (61h31m42.815799933s) [upload=53967]: Uploading segments... Dec 8 05:00:42.944796501 (61h31m42.815879556s) [upload=53967]: Got next segment. Inline: true Dec 8 05:00:42.944804315 (61h31m42.81588736s) [upload=53967]: Waiting for error group managing segments... Dec 8 05:00:42.944874950 (61h31m42.815957995s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 05:00:42.944882524 (61h31m42.815965569s) [upload=53967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 05:00:42.944886632 (61h31m42.815969677s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:01:41.678299330 (61h32m41.549382375s) [upload=53967]: Done uploading segments... Dec 8 05:01:41.678338003 (61h32m41.549421038s) [upload=53967]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.679640524s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X..............X....] duration: 7.138349388s trace: https://jaeger.dev.storj.io/trace/7deb1ce8838eb9dc FAIL (2025-12-08 05:25:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 7.138376969s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................X........................X.] duration: 3.580429056s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:25:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.580459413s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 7.014692573s trace: https://jaeger.dev.storj.io/trace/327d8af62af2ad4a FAIL (2025-12-08 05:25:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 04:41:10.986572683 (61h12m10.857655728s) [upload=53698]: Starting upload Dec 8 04:41:10.986697500 (61h12m10.857780545s) [upload=53698]: Done starting upload Dec 8 04:41:10.986782503 (61h12m10.857865538s) [upload=53698]: Uploading segments... Dec 8 04:41:10.987063708 (61h12m10.858146753s) [upload=53698]: Got next segment. Inline: false Dec 8 04:41:10.987116498 (61h12m10.858199543s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 04:41:10.987121758 (61h12m10.858204803s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 04:41:17.462876699 (61h12m17.333959744s) [seg_pos={0 0}, upload=53698]: Begin upload segment... Dec 8 04:41:17.462933336 (61h12m17.334016381s) [seg_pos={0 0}, upload=53698]: Done begin upload segment. Dec 8 04:41:17.462963864 (61h12m17.334046909s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464241417 (61h12m17.335324452s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464758772 (61h12m17.335841817s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465245028 (61h12m17.336328063s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465727617 (61h12m17.336810672s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.466300738 (61h12m17.337383783s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.467904602 (61h12m17.338987647s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.469643584 (61h12m17.340726629s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.470720414 (61h12m17.341803449s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.472841653 (61h12m17.343924708s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.474783842 (61h12m17.345866877s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.478925869 (61h12m17.350008904s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.482146932 (61h12m17.353229977s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.484118316 (61h12m17.355201361s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.486216912 (61h12m17.357299957s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.487427918 (61h12m17.358510953s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:19.196950317 (61h12m19.068033352s) [upload=53698]: Next returned nil segment Dec 8 04:41:19.196972289 (61h12m19.068055324s) [upload=53698]: Waiting for error group managing segments... Dec 8 04:41:19.470957375 (61h12m19.34204042s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.478965694 (61h12m19.350048739s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.488459723 (61h12m19.359542758s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.491834840 (61h12m19.362917885s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.496467461 (61h12m19.367550506s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.497643140 (61h12m19.368726185s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.513620774 (61h12m19.384703809s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.519169180 (61h12m19.390252225s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.582513759 (61h12m19.453596794s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.600844513 (61h12m19.471927549s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.627512986 (61h12m19.498596031s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.923827261 (61h12m19.794910306s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940676124 (61h12m19.811759159s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940696483 (61h12m19.811779518s) [seg_pos={0 0}, upload=53698]: Segment reached optimal threshold of 13 pieces. Dec 8 04:41:19.940920650 (61h12m19.812003695s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.940927292 (61h12m19.812010347s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941137082 (61h12m19.812220117s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941146079 (61h12m19.812229124s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941154806 (61h12m19.812237851s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a9UG3xktEYLqGrk6Z1YRdzSd7EF8CpjJFLdLHi46PUXS92rSg): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941162220 (61h12m19.812245255s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941203298 (61h12m19.812286343s) [seg_pos={0 0}, upload=53698]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 04:41:19.941272510 (61h12m19.812355555s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 04:41:19.941277359 (61h12m19.812360404s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 04:50:23.376780170 (61h21m23.247863205s) [upload=53698]: Done uploading segments... Dec 8 04:50:23.376921268 (61h21m23.248004313s) [upload=53698]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.014737549s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...............X............................X...............] duration: 5.71552625s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:25:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.715553281s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 465.68367ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/17143a9730f83ede FAIL (2025-12-08 05:25:40 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 465.712064ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.095447784s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:25:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.095501546s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [X......................X...X..X.............................] duration: 5.694576509s trace: https://jaeger.dev.storj.io/trace/dc88131578b4b73 FAIL (2025-12-08 05:25:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.694605733s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X..............X...] duration: 6.11953777s trace: https://jaeger.dev.storj.io/trace/7deb1ce8838eb9dc FAIL (2025-12-08 05:25:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.119592574s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [................X............................X..............] duration: 5.814831018s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:25:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.814856336s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.211275124s trace: https://jaeger.dev.storj.io/trace/56ba3625fd29e75 FAIL (2025-12-08 05:25:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 05:00:42.944581611 (61h31m42.815664646s) [upload=53967]: Starting upload Dec 8 05:00:42.944670691 (61h31m42.815753736s) [upload=53967]: Done starting upload Dec 8 05:00:42.944716888 (61h31m42.815799933s) [upload=53967]: Uploading segments... Dec 8 05:00:42.944796501 (61h31m42.815879556s) [upload=53967]: Got next segment. Inline: true Dec 8 05:00:42.944804315 (61h31m42.81588736s) [upload=53967]: Waiting for error group managing segments... Dec 8 05:00:42.944874950 (61h31m42.815957995s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 05:00:42.944882524 (61h31m42.815965569s) [upload=53967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 05:00:42.944886632 (61h31m42.815969677s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:01:41.678299330 (61h32m41.549382375s) [upload=53967]: Done uploading segments... Dec 8 05:01:41.678338003 (61h32m41.549421038s) [upload=53967]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.211305441s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X..........X................................................] duration: 7.467257742s trace: https://jaeger.dev.storj.io/trace/327d8af62af2ad4a FAIL (2025-12-08 05:24:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 04:41:10.986572683 (61h12m10.857655728s) [upload=53698]: Starting upload Dec 8 04:41:10.986697500 (61h12m10.857780545s) [upload=53698]: Done starting upload Dec 8 04:41:10.986782503 (61h12m10.857865538s) [upload=53698]: Uploading segments... Dec 8 04:41:10.987063708 (61h12m10.858146753s) [upload=53698]: Got next segment. Inline: false Dec 8 04:41:10.987116498 (61h12m10.858199543s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 04:41:10.987121758 (61h12m10.858204803s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 04:41:17.462876699 (61h12m17.333959744s) [seg_pos={0 0}, upload=53698]: Begin upload segment... Dec 8 04:41:17.462933336 (61h12m17.334016381s) [seg_pos={0 0}, upload=53698]: Done begin upload segment. Dec 8 04:41:17.462963864 (61h12m17.334046909s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464241417 (61h12m17.335324452s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464758772 (61h12m17.335841817s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465245028 (61h12m17.336328063s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465727617 (61h12m17.336810672s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.466300738 (61h12m17.337383783s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.467904602 (61h12m17.338987647s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.469643584 (61h12m17.340726629s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.470720414 (61h12m17.341803449s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.472841653 (61h12m17.343924708s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.474783842 (61h12m17.345866877s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.478925869 (61h12m17.350008904s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.482146932 (61h12m17.353229977s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.484118316 (61h12m17.355201361s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.486216912 (61h12m17.357299957s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.487427918 (61h12m17.358510953s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:19.196950317 (61h12m19.068033352s) [upload=53698]: Next returned nil segment Dec 8 04:41:19.196972289 (61h12m19.068055324s) [upload=53698]: Waiting for error group managing segments... Dec 8 04:41:19.470957375 (61h12m19.34204042s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.478965694 (61h12m19.350048739s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.488459723 (61h12m19.359542758s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.491834840 (61h12m19.362917885s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.496467461 (61h12m19.367550506s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.497643140 (61h12m19.368726185s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.513620774 (61h12m19.384703809s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.519169180 (61h12m19.390252225s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.582513759 (61h12m19.453596794s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.600844513 (61h12m19.471927549s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.627512986 (61h12m19.498596031s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.923827261 (61h12m19.794910306s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940676124 (61h12m19.811759159s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940696483 (61h12m19.811779518s) [seg_pos={0 0}, upload=53698]: Segment reached optimal threshold of 13 pieces. Dec 8 04:41:19.940920650 (61h12m19.812003695s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.940927292 (61h12m19.812010347s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941137082 (61h12m19.812220117s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941146079 (61h12m19.812229124s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941154806 (61h12m19.812237851s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a9UG3xktEYLqGrk6Z1YRdzSd7EF8CpjJFLdLHi46PUXS92rSg): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941162220 (61h12m19.812245255s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941203298 (61h12m19.812286343s) [seg_pos={0 0}, upload=53698]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 04:41:19.941272510 (61h12m19.812355555s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 04:41:19.941277359 (61h12m19.812360404s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 04:50:23.376780170 (61h21m23.247863205s) [upload=53698]: Done uploading segments... Dec 8 04:50:23.376921268 (61h21m23.248004313s) [upload=53698]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.467279904s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................X........................X] duration: 5.000781415s trace: https://jaeger.dev.storj.io/trace/5670eb16eb723b86 FAIL (2025-12-08 05:24:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000926041s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X..............X..] duration: 6.851515595s trace: https://jaeger.dev.storj.io/trace/7deb1ce8838eb9dc FAIL (2025-12-08 05:24:45 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.851539671s core uplink us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 680.685237ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/17143a9730f83ede FAIL (2025-12-08 05:24:31 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 680.716096ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 4.957461937s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:24:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.957497937s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.................X............................X.............] duration: 5.817006329s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:24:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.817037319s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.X......................X...X..X............................] duration: 5.957353143s trace: https://jaeger.dev.storj.io/trace/dc88131578b4b73 FAIL (2025-12-08 05:24:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.957385184s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................X........................] duration: 3.584614188s trace: https://jaeger.dev.storj.io/trace/6a97b281451dc1c7 FAIL (2025-12-08 05:24:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.584652401s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X..........X...............................................] duration: 6.729582705s trace: https://jaeger.dev.storj.io/trace/327d8af62af2ad4a FAIL (2025-12-08 05:24:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 04:41:10.986572683 (61h12m10.857655728s) [upload=53698]: Starting upload Dec 8 04:41:10.986697500 (61h12m10.857780545s) [upload=53698]: Done starting upload Dec 8 04:41:10.986782503 (61h12m10.857865538s) [upload=53698]: Uploading segments... Dec 8 04:41:10.987063708 (61h12m10.858146753s) [upload=53698]: Got next segment. Inline: false Dec 8 04:41:10.987116498 (61h12m10.858199543s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 04:41:10.987121758 (61h12m10.858204803s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 04:41:17.462876699 (61h12m17.333959744s) [seg_pos={0 0}, upload=53698]: Begin upload segment... Dec 8 04:41:17.462933336 (61h12m17.334016381s) [seg_pos={0 0}, upload=53698]: Done begin upload segment. Dec 8 04:41:17.462963864 (61h12m17.334046909s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464241417 (61h12m17.335324452s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464758772 (61h12m17.335841817s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465245028 (61h12m17.336328063s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465727617 (61h12m17.336810672s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.466300738 (61h12m17.337383783s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.467904602 (61h12m17.338987647s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.469643584 (61h12m17.340726629s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.470720414 (61h12m17.341803449s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.472841653 (61h12m17.343924708s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.474783842 (61h12m17.345866877s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.478925869 (61h12m17.350008904s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.482146932 (61h12m17.353229977s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.484118316 (61h12m17.355201361s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.486216912 (61h12m17.357299957s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.487427918 (61h12m17.358510953s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:19.196950317 (61h12m19.068033352s) [upload=53698]: Next returned nil segment Dec 8 04:41:19.196972289 (61h12m19.068055324s) [upload=53698]: Waiting for error group managing segments... Dec 8 04:41:19.470957375 (61h12m19.34204042s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.478965694 (61h12m19.350048739s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.488459723 (61h12m19.359542758s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.491834840 (61h12m19.362917885s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.496467461 (61h12m19.367550506s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.497643140 (61h12m19.368726185s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.513620774 (61h12m19.384703809s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.519169180 (61h12m19.390252225s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.582513759 (61h12m19.453596794s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.600844513 (61h12m19.471927549s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.627512986 (61h12m19.498596031s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.923827261 (61h12m19.794910306s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940676124 (61h12m19.811759159s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940696483 (61h12m19.811779518s) [seg_pos={0 0}, upload=53698]: Segment reached optimal threshold of 13 pieces. Dec 8 04:41:19.940920650 (61h12m19.812003695s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.940927292 (61h12m19.812010347s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941137082 (61h12m19.812220117s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941146079 (61h12m19.812229124s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941154806 (61h12m19.812237851s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a9UG3xktEYLqGrk6Z1YRdzSd7EF8CpjJFLdLHi46PUXS92rSg): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941162220 (61h12m19.812245255s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941203298 (61h12m19.812286343s) [seg_pos={0 0}, upload=53698]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 04:41:19.941272510 (61h12m19.812355555s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 04:41:19.941277359 (61h12m19.812360404s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 04:50:23.376780170 (61h21m23.247863205s) [upload=53698]: Done uploading segments... Dec 8 04:50:23.376921268 (61h21m23.248004313s) [upload=53698]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.729614415s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.771248321s trace: https://jaeger.dev.storj.io/trace/56ba3625fd29e75 FAIL (2025-12-08 05:23:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 05:00:42.944581611 (61h31m42.815664646s) [upload=53967]: Starting upload Dec 8 05:00:42.944670691 (61h31m42.815753736s) [upload=53967]: Done starting upload Dec 8 05:00:42.944716888 (61h31m42.815799933s) [upload=53967]: Uploading segments... Dec 8 05:00:42.944796501 (61h31m42.815879556s) [upload=53967]: Got next segment. Inline: true Dec 8 05:00:42.944804315 (61h31m42.81588736s) [upload=53967]: Waiting for error group managing segments... Dec 8 05:00:42.944874950 (61h31m42.815957995s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 05:00:42.944882524 (61h31m42.815965569s) [upload=53967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 05:00:42.944886632 (61h31m42.815969677s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:01:41.678299330 (61h32m41.549382375s) [upload=53967]: Done uploading segments... Dec 8 05:01:41.678338003 (61h32m41.549421038s) [upload=53967]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.771277858s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 470.704229ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/17143a9730f83ede FAIL (2025-12-08 05:23:54 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 470.732433ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..................X............................X............] duration: 6.044520992s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:23:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.044553012s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X..............X.] duration: 6.524532666s trace: https://jaeger.dev.storj.io/trace/7deb1ce8838eb9dc FAIL (2025-12-08 05:23:45 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.524547904s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..X......................X...X..X...........................] duration: 5.920009199s trace: https://jaeger.dev.storj.io/trace/dc88131578b4b73 FAIL (2025-12-08 05:23:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.920039818s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X..............X] duration: 2m14.011432277s trace: https://jaeger.dev.storj.io/trace/7deb1ce8838eb9dc FAIL (2025-12-08 05:23:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2m14.011471651s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................X.......................] duration: 3.469247618s trace: https://jaeger.dev.storj.io/trace/6a97b281451dc1c7 FAIL (2025-12-08 05:23:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.469274919s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 466.617006ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/17143a9730f83ede FAIL (2025-12-08 05:23:25 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 466.650771ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.692992569s trace: https://jaeger.dev.storj.io/trace/56ba3625fd29e75 FAIL (2025-12-08 05:23:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 05:00:42.944581611 (61h31m42.815664646s) [upload=53967]: Starting upload Dec 8 05:00:42.944670691 (61h31m42.815753736s) [upload=53967]: Done starting upload Dec 8 05:00:42.944716888 (61h31m42.815799933s) [upload=53967]: Uploading segments... Dec 8 05:00:42.944796501 (61h31m42.815879556s) [upload=53967]: Got next segment. Inline: true Dec 8 05:00:42.944804315 (61h31m42.81588736s) [upload=53967]: Waiting for error group managing segments... Dec 8 05:00:42.944874950 (61h31m42.815957995s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 05:00:42.944882524 (61h31m42.815965569s) [upload=53967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 05:00:42.944886632 (61h31m42.815969677s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:01:41.678299330 (61h32m41.549382375s) [upload=53967]: Done uploading segments... Dec 8 05:01:41.678338003 (61h32m41.549421038s) [upload=53967]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.693020161s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.019997469s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:23:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.020026393s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...................X............................X...........] duration: 5.695041662s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:23:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.69507146s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.830360224s trace: https://jaeger.dev.storj.io/trace/56ba3625fd29e75 FAIL (2025-12-08 05:22:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 05:00:42.944581611 (61h31m42.815664646s) [upload=53967]: Starting upload Dec 8 05:00:42.944670691 (61h31m42.815753736s) [upload=53967]: Done starting upload Dec 8 05:00:42.944716888 (61h31m42.815799933s) [upload=53967]: Uploading segments... Dec 8 05:00:42.944796501 (61h31m42.815879556s) [upload=53967]: Got next segment. Inline: true Dec 8 05:00:42.944804315 (61h31m42.81588736s) [upload=53967]: Waiting for error group managing segments... Dec 8 05:00:42.944874950 (61h31m42.815957995s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 05:00:42.944882524 (61h31m42.815965569s) [upload=53967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 05:00:42.944886632 (61h31m42.815969677s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:01:41.678299330 (61h32m41.549382375s) [upload=53967]: Done uploading segments... Dec 8 05:01:41.678338003 (61h32m41.549421038s) [upload=53967]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.830387516s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X..........X..............................................] duration: 7.139732537s trace: https://jaeger.dev.storj.io/trace/327d8af62af2ad4a FAIL (2025-12-08 05:22:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 04:41:10.986572683 (61h12m10.857655728s) [upload=53698]: Starting upload Dec 8 04:41:10.986697500 (61h12m10.857780545s) [upload=53698]: Done starting upload Dec 8 04:41:10.986782503 (61h12m10.857865538s) [upload=53698]: Uploading segments... Dec 8 04:41:10.987063708 (61h12m10.858146753s) [upload=53698]: Got next segment. Inline: false Dec 8 04:41:10.987116498 (61h12m10.858199543s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 04:41:10.987121758 (61h12m10.858204803s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 04:41:17.462876699 (61h12m17.333959744s) [seg_pos={0 0}, upload=53698]: Begin upload segment... Dec 8 04:41:17.462933336 (61h12m17.334016381s) [seg_pos={0 0}, upload=53698]: Done begin upload segment. Dec 8 04:41:17.462963864 (61h12m17.334046909s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464241417 (61h12m17.335324452s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464758772 (61h12m17.335841817s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465245028 (61h12m17.336328063s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465727617 (61h12m17.336810672s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.466300738 (61h12m17.337383783s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.467904602 (61h12m17.338987647s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.469643584 (61h12m17.340726629s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.470720414 (61h12m17.341803449s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.472841653 (61h12m17.343924708s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.474783842 (61h12m17.345866877s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.478925869 (61h12m17.350008904s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.482146932 (61h12m17.353229977s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.484118316 (61h12m17.355201361s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.486216912 (61h12m17.357299957s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.487427918 (61h12m17.358510953s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:19.196950317 (61h12m19.068033352s) [upload=53698]: Next returned nil segment Dec 8 04:41:19.196972289 (61h12m19.068055324s) [upload=53698]: Waiting for error group managing segments... Dec 8 04:41:19.470957375 (61h12m19.34204042s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.478965694 (61h12m19.350048739s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.488459723 (61h12m19.359542758s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.491834840 (61h12m19.362917885s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.496467461 (61h12m19.367550506s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.497643140 (61h12m19.368726185s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.513620774 (61h12m19.384703809s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.519169180 (61h12m19.390252225s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.582513759 (61h12m19.453596794s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.600844513 (61h12m19.471927549s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.627512986 (61h12m19.498596031s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.923827261 (61h12m19.794910306s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940676124 (61h12m19.811759159s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940696483 (61h12m19.811779518s) [seg_pos={0 0}, upload=53698]: Segment reached optimal threshold of 13 pieces. Dec 8 04:41:19.940920650 (61h12m19.812003695s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.940927292 (61h12m19.812010347s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941137082 (61h12m19.812220117s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941146079 (61h12m19.812229124s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941154806 (61h12m19.812237851s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a9UG3xktEYLqGrk6Z1YRdzSd7EF8CpjJFLdLHi46PUXS92rSg): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941162220 (61h12m19.812245255s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941203298 (61h12m19.812286343s) [seg_pos={0 0}, upload=53698]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 04:41:19.941272510 (61h12m19.812355555s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 04:41:19.941277359 (61h12m19.812360404s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 04:50:23.376780170 (61h21m23.247863205s) [upload=53698]: Done uploading segments... Dec 8 04:50:23.376921268 (61h21m23.248004313s) [upload=53698]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.139761111s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................X......................] duration: 3.525235068s trace: https://jaeger.dev.storj.io/trace/6a97b281451dc1c7 FAIL (2025-12-08 05:22:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.525721805s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 470.626953ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/17143a9730f83ede FAIL (2025-12-08 05:22:50 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 470.653424ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....................X............................X..........] duration: 5.451086806s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:22:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.45111107s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...X......................X...X..X..........................] duration: 5.751010811s trace: https://jaeger.dev.storj.io/trace/dc88131578b4b73 FAIL (2025-12-08 05:22:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.751045648s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.001408481s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:22:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.001440001s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..X..........X.............................................] duration: 5.777254035s trace: https://jaeger.dev.storj.io/trace/327d8af62af2ad4a FAIL (2025-12-08 05:22:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 04:41:10.986572683 (61h12m10.857655728s) [upload=53698]: Starting upload Dec 8 04:41:10.986697500 (61h12m10.857780545s) [upload=53698]: Done starting upload Dec 8 04:41:10.986782503 (61h12m10.857865538s) [upload=53698]: Uploading segments... Dec 8 04:41:10.987063708 (61h12m10.858146753s) [upload=53698]: Got next segment. Inline: false Dec 8 04:41:10.987116498 (61h12m10.858199543s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 04:41:10.987121758 (61h12m10.858204803s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 04:41:17.462876699 (61h12m17.333959744s) [seg_pos={0 0}, upload=53698]: Begin upload segment... Dec 8 04:41:17.462933336 (61h12m17.334016381s) [seg_pos={0 0}, upload=53698]: Done begin upload segment. Dec 8 04:41:17.462963864 (61h12m17.334046909s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464241417 (61h12m17.335324452s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.464758772 (61h12m17.335841817s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465245028 (61h12m17.336328063s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.465727617 (61h12m17.336810672s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.466300738 (61h12m17.337383783s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.467904602 (61h12m17.338987647s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.469643584 (61h12m17.340726629s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.470720414 (61h12m17.341803449s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.472841653 (61h12m17.343924708s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.474783842 (61h12m17.345866877s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.478925869 (61h12m17.350008904s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.482146932 (61h12m17.353229977s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.484118316 (61h12m17.355201361s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.486216912 (61h12m17.357299957s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:17.487427918 (61h12m17.358510953s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Uploading piece... Dec 8 04:41:19.196950317 (61h12m19.068033352s) [upload=53698]: Next returned nil segment Dec 8 04:41:19.196972289 (61h12m19.068055324s) [upload=53698]: Waiting for error group managing segments... Dec 8 04:41:19.470957375 (61h12m19.34204042s) [noise=true , address=145.79.227.40:4051 , piece_id=Z3JV2JYCGSZTSOKXPQFLG3LFXE3XSZXMEI6RKLWR7AIJWVE7F5VA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.478965694 (61h12m19.350048739s) [noise=true , address=145.79.227.22:4510 , piece_id=ME3CNTADT3MKZ7A7O35HQ77I3QEJ4RDHZ3HWNXTK74WCXXTVFGHA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.488459723 (61h12m19.359542758s) [noise=true , address=145.79.227.29:4943 , piece_id=W7RBOTEMANEW5K2RNN5VH25ZZWR7ENEZIWZYKGNL7CLYMFP5KSYA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.491834840 (61h12m19.362917885s) [noise=true , address=145.79.227.39:4014 , piece_id=42YQDT5VNDBCG42TGQE5XEO7V4M3FLXEBPCWNWF4VTDD4GVTD2MQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.496467461 (61h12m19.367550506s) [noise=true , address=145.79.227.28:4725 , piece_id=2KZFS66KORIJR7AJXPFK2YDIU5BGRNNYFUSMF2QCJHBXH4UJ5VLQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.497643140 (61h12m19.368726185s) [noise=true , address=145.79.227.26:4653 , piece_id=VXRBIXTQMICMWYO3QUTXC6WYEAMWLH5HDM6DGA3QSVJT6XUYQ4CQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.513620774 (61h12m19.384703809s) [noise=true , address=145.79.227.21:4474 , piece_id=ALCSXYN2JKG3WWKBYAGU3HSJGILRK324Q6BFUB3XAN7BRWIFUS6Q, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.519169180 (61h12m19.390252225s) [noise=true , address=145.79.227.24:4583 , piece_id=D66DYNF7HFKQXG2BZ7A7MS4TQQEUT7VXEUB4Q6K5E45QQ3KBLRPQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.582513759 (61h12m19.453596794s) [noise=true , address=77.90.31.18:4807 , piece_id=CG6IOIJXBGUWZHHSTI3CYHGQFHKJIUENOO7SXIMHMSKPT6KJC7OQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.600844513 (61h12m19.471927549s) [noise=true , address=77.90.31.13:4628 , piece_id=U3GVPVFRIIIOKMG2LTQZ7HLFQ4CKA3PJ7KDMTN37SRUVLXQ7PBHQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.627512986 (61h12m19.498596031s) [noise=true , address=77.90.31.10:4518 , piece_id=PVAIQII44G5U6ULAIESSKG65ZG4NH7DLS4DR2D4PRVULTRBDN2UQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.923827261 (61h12m19.794910306s) [noise=true , address=145.79.227.42:4123 , piece_id=SUGMMCANVZOSRM6KJF2JZFNGKCS76A3BIVR7FPEVGIFS3UXYSCBA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940676124 (61h12m19.811759159s) [noise=true , address=145.79.227.26:4654 , piece_id=KRO6XVQCHI3CYVUGBH4N5LLMUDTN2TTI3D2TR7F5YB24KOCIKDJQ, seg_pos={0 0}, upload=53698]: Done uploading piece. err: <nil> Dec 8 04:41:19.940696483 (61h12m19.811779518s) [seg_pos={0 0}, upload=53698]: Segment reached optimal threshold of 13 pieces. Dec 8 04:41:19.940920650 (61h12m19.812003695s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.940927292 (61h12m19.812010347s) [noise=true , address=145.79.227.33:4871 , piece_id=CSYTGISPEKL3YEHEE5YLAPJQJ76C7H4KR44ASGSWPHWIQCD4R7RA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941137082 (61h12m19.812220117s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128SC59hAFBUVutPFym3iZv9qNYtgiqrk6q9RpfWL2ftyTt5Tzk): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941146079 (61h12m19.812229124s) [noise=true , address=145.79.227.21:4475 , piece_id=JZSLVHKHWCDZQM64QVSQYXZPORC63IY3U43X73Q5VPUDD3XCPKQA, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941154806 (61h12m19.812237851s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a9UG3xktEYLqGrk6Z1YRdzSd7EF8CpjJFLdLHi46PUXS92rSg): protocol: expected piece hash; context canceled; EOF Dec 8 04:41:19.941162220 (61h12m19.812245255s) [noise=true , address=145.79.227.27:4691 , piece_id=ESMSMYRQCCYAKGQYZCILQNNWHV3WACMYBDPEAEE44OUGZK3OGK3A, seg_pos={0 0}, upload=53698]: Long tail cancellation due to optimal threshold Dec 8 04:41:19.941203298 (61h12m19.812286343s) [seg_pos={0 0}, upload=53698]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 8 04:41:19.941272510 (61h12m19.812355555s) [upload=53698]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 04:41:19.941277359 (61h12m19.812360404s) [upload=53698]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 04:50:23.376780170 (61h21m23.247863205s) [upload=53698]: Done uploading segments... Dec 8 04:50:23.376921268 (61h21m23.248004313s) [upload=53698]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.77728261s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 467.80149ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/17143a9730f83ede FAIL (2025-12-08 05:22:09 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 467.8283ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.03146765s trace: https://jaeger.dev.storj.io/trace/56ba3625fd29e75 FAIL (2025-12-08 05:21:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 05:00:42.944581611 (61h31m42.815664646s) [upload=53967]: Starting upload Dec 8 05:00:42.944670691 (61h31m42.815753736s) [upload=53967]: Done starting upload Dec 8 05:00:42.944716888 (61h31m42.815799933s) [upload=53967]: Uploading segments... Dec 8 05:00:42.944796501 (61h31m42.815879556s) [upload=53967]: Got next segment. Inline: true Dec 8 05:00:42.944804315 (61h31m42.81588736s) [upload=53967]: Waiting for error group managing segments... Dec 8 05:00:42.944874950 (61h31m42.815957995s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 05:00:42.944882524 (61h31m42.815965569s) [upload=53967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 05:00:42.944886632 (61h31m42.815969677s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:01:41.678299330 (61h32m41.549382375s) [upload=53967]: Done uploading segments... Dec 8 05:01:41.678338003 (61h32m41.549421038s) [upload=53967]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.031497607s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 3.61063267s trace: https://jaeger.dev.storj.io/trace/6a97b281451dc1c7 FAIL (2025-12-08 05:21:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.610662126s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....................X............................X.........] duration: 5.776125085s trace: https://jaeger.dev.storj.io/trace/2f2c338d90b53c6a FAIL (2025-12-08 05:21:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== EQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.945321659 (61h44m53.816404704s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.948235246 (61h44m53.819318291s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.949968106 (61h44m53.821051151s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.951513610 (61h44m53.822596645s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.953069783 (61h44m53.824152818s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.954574448 (61h44m53.825657483s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.956233347 (61h44m53.827316382s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.959690801 (61h44m53.830773916s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.962924548 (61h44m53.834007583s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:53.965242032 (61h44m53.836325067s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Uploading piece... Dec 8 05:13:54.757403586 (61h44m54.628486621s) [upload=54152]: Next returned nil segment Dec 8 05:13:54.757421260 (61h44m54.628504305s) [upload=54152]: Waiting for error group managing segments... Dec 8 05:13:55.146717272 (61h44m55.017800327s) [noise=true , address=185.167.204.205:4005 , piece_id=NF32RVQS5SYX2KJLMRMIT34L5RB24VSD4LVN272YRNESUVDLRMLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.146984320 (61h44m55.018067355s) [noise=true , address=185.167.204.206:4070 , piece_id=LGHXVZVQC56MXY7UEDNXUSNWQETBOKK7CKMVZZCXRF5OZFL4S3GA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156637602 (61h44m55.027720647s) [noise=true , address=185.167.204.206:4067 , piece_id=PWIVXKDWNDL4OVBJ3JQ3UXXUOL5EUXTHA7OA4MJTS53JYDET6E6A, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.156674763 (61h44m55.027757798s) [noise=true , address=185.167.204.205:4014 , piece_id=N6SXV5E2JPEVOQHHVVUWSFYIITN2VICYZITGPWPEHFO23OQ73D6Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.158824797 (61h44m55.029907832s) [noise=true , address=185.167.204.206:4048 , piece_id=PDIGLXMADNTE7D67HS2FLADXMEIS6SM2NQ3W4FZ2DHSNDMGGJXPQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.163441318 (61h44m55.034524363s) [noise=true , address=185.167.204.206:4071 , piece_id=YHTAEZQP2WEXFDDNWLDFXB2WB6SFZRGFLLDUCOI4S33EWU2L35JQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.164851433 (61h44m55.035934488s) [noise=true , address=185.167.204.206:4057 , piece_id=IHAU4Y4GRA3DORZTDNA7DSCRMNXGR37PIX47IMCEIBLBQBRVHRXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.169609775 (61h44m55.04069282s) [noise=true , address=185.167.204.206:4051 , piece_id=UKMUIA6SGYM552SLDQKBSU7QLHO5H76T6S5DZ4AJ7BQ7MT67BWWQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.177944807 (61h44m55.049027842s) [noise=true , address=185.167.204.206:4062 , piece_id=YJJ5UR3AIEY4JZB7P7YW2ABVIYBWAPK5XOQ3O7MNSEEUC3VWDEGQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.184461095 (61h44m55.05554414s) [noise=true , address=185.167.204.206:4039 , piece_id=3THT7VWPWUCWMADDHCCKAFI4LPLV637KBQCA3W2XXMZDG4IIC7GQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192345458 (61h44m55.063428494s) [noise=true , address=185.167.204.205:4031 , piece_id=7NEQLGDRUHABS62A2HGA4JDBQI4MJMIRS3WRLKJFGL6QEAU3OR4Q, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.192395294 (61h44m55.063478329s) [noise=true , address=185.167.204.205:4032 , piece_id=LUNQTAN5S7PYC7HPRTV2N2OX5K7EEXECVV5LNAMHNQNF5K3QJDEA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.195032566 (61h44m55.066115601s) [noise=true , address=185.167.204.206:4054 , piece_id=WSNJL6PE3DYZH3XVFZKMMONV6XB7CSZCQXFBRFJLCR4SEFR2IVLA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.197822328 (61h44m55.068905373s) [noise=true , address=185.167.204.206:4052 , piece_id=IUOTSA2VUN7WMKRIOIN4R2JDUCAQKZLPSLECCOTAXSGJZQAKAMOQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.198619216 (61h44m55.069702261s) [noise=true , address=185.167.204.206:4049 , piece_id=4OAB7IRBS32HAA7QY7DUGZA6MKIZSPIMA2ZDDMO6SYVDC42CAUGA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.700281009 (61h44m55.571364044s) [noise=true , address=81.171.14.70:4025 , piece_id=NKAPPYA4KG4XBSTL7PPJJGRKMKK4ZR2YCFBWFFTJ5XZKXS5VDAQA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.731087963 (61h44m55.602171008s) [noise=true , address=81.171.14.70:4038 , piece_id=JGQYOISQXH4IRV5STGWPHOJVLKRMXXFMVSHDSURU6KSHGNSAETVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.741665655 (61h44m55.61274869s) [noise=true , address=81.171.14.70:4048 , piece_id=IN3LLTU6W4KAVTA4X46OCVCJL64XQBK4BB44RKJ2BBRU7JKJYAUA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.742234889 (61h44m55.613317924s) [noise=true , address=81.171.14.70:4039 , piece_id=ECVPBOOOK6ITBMRTJCSBOYM6AZUD54D3XS3ZD6SUUQH2WLDB3DVA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.743536487 (61h44m55.614619532s) [noise=true , address=81.171.14.70:4045 , piece_id=BUYPQZ6N34DTKQP57PV4VBSJJA7UVK5QFO5TYRPMSABI7JD2HZAQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.765543344 (61h44m55.636626379s) [noise=true , address=81.171.14.70:4028 , piece_id=XGKB467UWHAVAWBOQELQRS2YD4WTCB6D5QW6HREN5A4XCFKOQ7LQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.782032684 (61h44m55.653115739s) [noise=true , address=81.171.14.70:4030 , piece_id=FQPC3XHX4PBGQNHVTV44AQKNJMWHJCNPO7PHSRZDX2VRPHKAQIOA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.791823117 (61h44m55.662906162s) [noise=true , address=81.171.14.70:4044 , piece_id=AQYNZI4XAC2BH7AALPAZ3A27ZVVQX2Z2R5U2F7HVQ4MEXGAGUWXA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:55.822339297 (61h44m55.693422342s) [noise=true , address=81.171.14.70:4042 , piece_id=6GYHNEHYX7L7TXMNAMKR5NCBFH4Y24VFL4UEEZ7UEXVRQHQ2ZSJA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.371527583 (61h44m56.242610628s) [noise=true , address=89.149.201.147:4002 , piece_id=TWR2RA2AQCENVGMVF5L3CGYC2HA6XGQFFPFQZI6ZIBQ5GHXMXUSA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385616260 (61h44m56.256699305s) [noise=true , address=89.149.201.147:4018 , piece_id=24T2U3C7NXJEE3TN3E2BBVL5D56D2BSEVTX7SG7OHOM6WWOECOVQ, seg_pos={0 0}, upload=54152]: Done uploading piece. err: <nil> Dec 8 05:13:56.385645005 (61h44m56.25672805s) [seg_pos={0 0}, upload=54152]: Segment reached optimal threshold of 26 pieces. Dec 8 05:13:56.385860696 (61h44m56.256943731s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385868590 (61h44m56.256951625s) [noise=true , address=89.149.201.147:4001 , piece_id=H2CCZHFZMRVMSNSENYVBLPBN5WHC5WDMBV3AHGKJTTSHOF34JVYA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385904549 (61h44m56.256987594s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF Dec 8 05:13:56.385919127 (61h44m56.257002202s) [noise=true , address=89.149.201.147:4005 , piece_id=ACD22KVLH5SMC7Q6ZEA5754M32MZWIBWVRTGU5VAELFYCCANJ7UA, seg_pos={0 0}, upload=54152]: Long tail cancellation due to optimal threshold Dec 8 05:13:56.385952220 (61h44m56.257035255s) [seg_pos={0 0}, upload=54152]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 8 05:13:56.386086716 (61h44m56.257169752s) [upload=54152]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 8 05:13:56.386096575 (61h44m56.25717962s) [upload=54152]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:14:51.262411316 (61h45m51.133494361s) [upload=54152]: Done uploading segments... Dec 8 05:14:51.262461482 (61h45m51.133544517s) [upload=54152]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.776144252s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 477.781357ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/17143a9730f83ede FAIL (2025-12-08 05:21:49 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 477.806495ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.244959942s trace: https://jaeger.dev.storj.io/trace/64fb8221d53ccb00 FAIL (2025-12-08 05:21:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.244988738s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.068086421s trace: https://jaeger.dev.storj.io/trace/56ba3625fd29e75 FAIL (2025-12-08 05:21:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 8 05:00:42.944581611 (61h31m42.815664646s) [upload=53967]: Starting upload Dec 8 05:00:42.944670691 (61h31m42.815753736s) [upload=53967]: Done starting upload Dec 8 05:00:42.944716888 (61h31m42.815799933s) [upload=53967]: Uploading segments... Dec 8 05:00:42.944796501 (61h31m42.815879556s) [upload=53967]: Got next segment. Inline: true Dec 8 05:00:42.944804315 (61h31m42.81588736s) [upload=53967]: Waiting for error group managing segments... Dec 8 05:00:42.944874950 (61h31m42.815957995s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 05:00:42.944882524 (61h31m42.815965569s) [upload=53967]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 8 05:00:42.944886632 (61h31m42.815969677s) [upload=53967]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 8 05:01:41.678299330 (61h32m41.549382375s) [upload=53967]: Done uploading segments... Dec 8 05:01:41.678338003 (61h32m41.549421038s) [upload=53967]: Upload finished. err: metaclient: context deadline exceeded Duration:* 2.068116818s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)