Orbiter History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..........................X.X...............................] duration: 795.890699ms target: https://us1.storj.io/login FAIL (2025-08-31 13:18:01 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 795.915206ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X..XX..................................] duration: 2.292736465s FAIL (2025-08-31 13:17:57 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.292760462s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 6.13064164s FAIL (2025-08-31 13:17:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.130663902s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 6.307926611s FAIL (2025-08-31 13:17:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.307952151s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.090629759s FAIL (2025-08-31 13:17:29 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 2.090653304s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................XX..............................] duration: 6.582923295s FAIL (2025-08-31 13:17:16 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.582954915s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X..XX.................................] duration: 2.332287513s FAIL (2025-08-31 13:17:08 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.332315907s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [...........................X.X..............................] duration: 726.551205ms target: https://us1.storj.io/login FAIL (2025-08-31 13:17:08 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 726.578757ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.32776501s FAIL (2025-08-31 13:16:57 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 2.327806359s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 6.471134408s FAIL (2025-08-31 13:16:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.471164637s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 6.149243318s FAIL (2025-08-31 13:16:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.149268486s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 6.03956267s FAIL (2025-08-31 13:16:26 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.039589282s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.249006003s FAIL (2025-08-31 13:16:24 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 2.249030778s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [............................X.X.............................] duration: 1.039128227s target: https://us1.storj.io/login FAIL (2025-08-31 13:16:05 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 1.039156302s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X..XX................................] duration: 2.258425373s FAIL (2025-08-31 13:15:55 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.258451161s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 6.476315139s FAIL (2025-08-31 13:15:41 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.476345538s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 6.460993872s FAIL (2025-08-31 13:15:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.461018058s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 4.208424184s FAIL (2025-08-31 13:15:36 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.208447378s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 6.395175187s FAIL (2025-08-31 13:15:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.395220012s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 6.17616585s FAIL (2025-08-31 13:15:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.176196819s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.............................X.X............................] duration: 712.736429ms target: https://us1.storj.io/login FAIL (2025-08-31 13:14:52 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 712.787426ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X..XX...............................] duration: 2.108767445s FAIL (2025-08-31 13:14:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.108792954s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 6.592894475s FAIL (2025-08-31 13:14:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.592921928s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.107549773s FAIL (2025-08-31 13:14:29 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 2.10757984s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 6.040590953s FAIL (2025-08-31 13:14:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.040620278s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X..XX..............................] duration: 2.241760458s FAIL (2025-08-31 13:13:53 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.241789873s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 6.776197804s FAIL (2025-08-31 13:13:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.776224584s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.370790744s FAIL (2025-08-31 13:13:42 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 2.370820581s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..............................X.X...........................] duration: 761.770382ms target: https://us1.storj.io/login FAIL (2025-08-31 13:13:40 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 761.795059ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [...............................X.X..........................] duration: 739.3377ms target: https://us1.storj.io/login FAIL (2025-08-31 13:13:15 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 739.374721ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 6.563365135s FAIL (2025-08-31 13:13:13 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.563391885s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 6.160326991s FAIL (2025-08-31 13:13:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.160349263s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.118059965s FAIL (2025-08-31 13:13:05 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 2.118084954s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X..XX.............................] duration: 2.231052407s FAIL (2025-08-31 13:12:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.231080871s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 6.089917646s FAIL (2025-08-31 13:12:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.089944778s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X..XX............................] duration: 2.169376516s FAIL (2025-08-31 13:12:39 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.169407826s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 6.310140295s FAIL (2025-08-31 13:12:34 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.310173349s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [................................X.X.........................] duration: 732.824657ms target: https://us1.storj.io/login FAIL (2025-08-31 13:12:32 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 732.84704ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X..XX...........................] duration: 2.305283746s FAIL (2025-08-31 13:12:22 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.30530673s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 6.170996797s FAIL (2025-08-31 13:12:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.171017515s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.367634288s FAIL (2025-08-31 13:12:04 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 2.367688171s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X..XX..........................] duration: 2.295395754s FAIL (2025-08-31 13:11:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.295418067s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.X........................] duration: 711.641595ms target: https://us1.storj.io/login FAIL (2025-08-31 13:11:55 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 711.681583ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 6.156927666s FAIL (2025-08-31 13:11:47 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.156950089s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X..XX.........................] duration: 2.218966482s FAIL (2025-08-31 13:11:19 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 31 12:55:03.441619160 (46h47m0.121814729s) [upload=41130]: Starting upload Aug 31 12:55:03.441712168 (46h47m0.121907767s) [upload=41130]: Done starting upload Aug 31 12:55:03.441856173 (46h47m0.122051772s) [upload=41130]: Uploading segments... Aug 31 12:55:03.441960683 (46h47m0.122156252s) [upload=41130]: Got next segment. Inline: true Aug 31 12:55:03.441966745 (46h47m0.122162324s) [upload=41130]: Waiting for error group managing segments... Aug 31 12:55:03.442016209 (46h47m0.122211779s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:55:03.442021519 (46h47m0.122217088s) [upload=41130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 31 12:55:03.442024626 (46h47m0.122220195s) [upload=41130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:55:03.946537997 (46h47m0.626733566s) [upload=41130]: Done uploading segments... Aug 31 12:55:03.946558877 (46h47m0.626754446s) [upload=41130]: Upload finished. err: <nil> Duration:* 2.2189971s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 6.469328673s FAIL (2025-08-31 13:11:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.46935849s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.182536776s FAIL (2025-08-31 13:10:53 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 2.182563097s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 5.991253159s FAIL (2025-08-31 13:10:49 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.991275061s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.X.......................] duration: 706.283852ms target: https://us1.storj.io/login FAIL (2025-08-31 13:10:46 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 706.307538ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 7.773265188s FAIL (2025-08-31 13:10:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== :54:20.466112488 (46h46m17.146308057s) [upload=41121]: Starting upload Aug 31 12:54:20.466181300 (46h46m17.146376869s) [upload=41121]: Done starting upload Aug 31 12:54:20.466293645 (46h46m17.146489214s) [upload=41121]: Uploading segments... Aug 31 12:54:20.466415478 (46h46m17.146611047s) [upload=41121]: Got next segment. Inline: false Aug 31 12:54:20.466452830 (46h46m17.146648399s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 31 12:54:20.466457549 (46h46m17.146653118s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 31 12:54:21.294424434 (46h46m17.974620003s) [seg_pos={0 0}, upload=41121]: Begin upload segment... Aug 31 12:54:21.294491232 (46h46m17.974686801s) [seg_pos={0 0}, upload=41121]: Done begin upload segment. Aug 31 12:54:21.294528533 (46h46m17.974724102s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294553080 (46h46m17.974748649s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294599369 (46h46m17.974794938s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.294949769 (46h46m17.975145338s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295004123 (46h46m17.975199692s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295241668 (46h46m17.975437237s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295363952 (46h46m17.975559521s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295598250 (46h46m17.975793809s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.295637255 (46h46m17.975832824s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296028964 (46h46m17.976224533s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.296054323 (46h46m17.976249902s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.297406550 (46h46m17.977602119s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298472500 (46h46m17.978668069s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.298936327 (46h46m17.979131896s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.299472263 (46h46m17.979667832s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300081980 (46h46m17.980277549s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.300620470 (46h46m17.980816039s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:21.301163599 (46h46m17.981359158s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Uploading piece... Aug 31 12:54:22.445988099 (46h46m19.126183668s) [upload=41121]: Next returned nil segment Aug 31 12:54:22.446001505 (46h46m19.126197065s) [upload=41121]: Waiting for error group managing segments... Aug 31 12:54:22.736812151 (46h46m19.41700772s) [noise=true , address=79.127.205.245:4244 , piece_id=6HXI6PPILQG3C7X4KYEA3ZAX4Z44LS4KW7GQEVQK22ZX722BGTGQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:22.739141308 (46h46m19.419336867s) [noise=true , address=79.127.205.246:4263 , piece_id=5DEIYDRBOZPDLTQDBVC6F47U7MLVZZ627WIWJUHYW4MCXDKZE3YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.224539823 (46h46m19.904735392s) [noise=true , address=45.91.116.12:4230 , piece_id=KD3LU6PNFIN6GMDZHJMNJY4HBPIZETMG6TXMPPZLZL3WSRZ3RN4Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.271009900 (46h46m19.951205469s) [noise=true , address=77.90.31.16:4752 , piece_id=AIHJKVIZOHP4K2RK3UDHRI5KNOZLQ6ZEMRCUG52XO3V67QTR3NKA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.276455820 (46h46m19.956651389s) [noise=true , address=104.36.82.21:4475 , piece_id=FRZXAJKN56BRN5SF6AUIZI4YVZ523TA6AHFDZBQTBNNGCOIK56UQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.296846557 (46h46m19.977042126s) [noise=true , address=104.36.82.47:4543 , piece_id=7SULW2ORT4MBDCNR2ZB4YSZY3DSK5J73HNZBEOWFSEKDI4FQEGMQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.317956980 (46h46m19.998152549s) [noise=true , address=77.90.31.18:4814 , piece_id=E6BX56GD5TRV3DM7XND37WKEY4M5RBSLEQEU6ALJGG5LNZEMYG6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.321357937 (46h46m20.001553506s) [noise=true , address=104.36.82.13:4219 , piece_id=4ZNQYJMRANHS5JFBXFEJPI2YD323ZTAT5KSW6U2BYQ3PLLTR63DA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.323031369 (46h46m20.003226938s) [noise=true , address=104.36.82.5:4842 , piece_id=TCQZJFUSWMCFV2FNIRGSCDKDYS3ITXFATVCAGIN4PRPUCAZABGJQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.326882398 (46h46m20.007077967s) [noise=true , address=104.36.82.15:4273 , piece_id=FECGOGMOAPU2NP7M5BYE6CHVZKZBXIVCSXCEA5H6S2WZZO2IUM3Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.334483402 (46h46m20.014678971s) [noise=true , address=104.36.82.6:4888 , piece_id=REU6R7TCSGR4UZKVSQF2Z5KT3PUI4EGI4ZMN6EDZGGRAPTJVH74Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.349026589 (46h46m20.029222158s) [noise=true , address=77.90.31.17:4795 , piece_id=UI6OHARYSVJ6J2I3FHKMPHHR2UPYE7CGPWVQJAEZ5MDDIHCDHROA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.353189805 (46h46m20.033385374s) [noise=true , address=104.36.82.48:4579 , piece_id=EZ4AJQ2JYWNSPBJC5UTPYZEGZZNTO2MEXK2YEMOB3SLIIGFLKVBA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357943061 (46h46m20.03813863s) [noise=true , address=104.36.82.40:4962 , piece_id=XBLGHDBFFEYKVDKJQLHIRRKPMLSM57MVGJ6HQNMTV4VCOXTEWB6Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: <nil> Aug 31 12:54:23.357966986 (46h46m20.038162555s) [seg_pos={0 0}, upload=41121]: Segment reached optimal threshold of 14 pieces. Aug 31 12:54:23.358105080 (46h46m20.038300639s) [noise=true , address=104.36.82.14:4227 , piece_id=5LNQ3CZJMD4B6VWJNANXVPOFTG6ZCAALVRW2QGZU5F3WBRQKDN5Q, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358182047 (46h46m20.038377617s) [noise=true , address=104.36.82.44:4875 , piece_id=IU2FPY3ZWINTTVPZVNUFY6APOKHR7DGWQUKF4AGXQSLUSCZ6ULEA, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358209420 (46h46m20.038404989s) [noise=true , address=104.36.82.46:4497 , piece_id=CERGPCKFKAZIXDCAAWEU2KS35KVNJX3PYR2DFYHULULR5D4CS2VQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zg4PSYBuLxFvF9oYiuvn65JNbjT5RdagcVAQLp2izvjPe1NEc): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358269535 (46h46m20.038465104s) [noise=true , address=104.36.82.60:4339 , piece_id=MFUIHLXIZMZK5NSUVQZLDWPFPF5BJV4UY5ESOUGWR2FFJ6LV36YQ, seg_pos={0 0}, upload=41121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF Aug 31 12:54:23.358293110 (46h46m20.038488679s) [seg_pos={0 0}, upload=41121]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 31 12:54:23.358370789 (46h46m20.038566358s) [upload=41121]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 31 12:54:23.358376369 (46h46m20.038571938s) [upload=41121]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 31 12:56:26.170691241 (46h48m22.85088682s) [upload=41121]: Done uploading segments... Aug 31 12:56:26.170715998 (46h48m22.850911567s) [upload=41121]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.773298001s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)