Orbiter History

checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 476.11347ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-10 06:10:08 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 476.132926ms edge linksharing us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 477.496245ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-10 06:09:26 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 477.51479ms edge linksharing us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 486.25926ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-10 06:08:40 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 486.283637ms edge linksharing us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 467.35937ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-10 06:08:13 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 467.385201ms edge linksharing us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 469.821627ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-10 06:07:03 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 469.836134ms edge linksharing us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001342832s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-10 06:07:02 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 30.001379002s edge linksharing us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 31.19363586s FAIL (2025-07-10 00:03:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 31.193658664s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 8.988837069s FAIL (2025-07-10 00:01:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 8.988868229s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.643265578s FAIL (2025-07-10 00:01:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.643292279s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 20.619600795s FAIL (2025-07-10 00:01:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 20.619622015s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 7.574651514s FAIL (2025-07-10 00:00:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 7.57467574s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.535730447s FAIL (2025-07-10 00:00:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.53575876s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 21.571455871s FAIL (2025-07-10 00:00:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 21.57149151s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 8.108319458s FAIL (2025-07-09 23:59:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.108342941s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 12.881210984s FAIL (2025-07-09 23:59:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.881232616s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 16.174242862s FAIL (2025-07-09 23:59:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 16.17428908s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.273927977s FAIL (2025-07-09 23:58:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.273960859s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 13.933830701s FAIL (2025-07-09 23:58:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 13.933860158s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.056359524s FAIL (2025-07-09 23:58:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.056380154s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 16.852408834s FAIL (2025-07-09 23:57:51 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 16.85243837s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 12.360496737s FAIL (2025-07-09 23:57:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.360513428s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X.......X...................................................] duration: 6.46377053s FAIL (2025-07-09 23:57:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.463792031s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 22.002580533s FAIL (2025-07-09 23:56:46 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 22.002607795s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.X.......X..................................................] duration: 12.683175751s FAIL (2025-07-09 23:56:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.683202843s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..X.......X.................................................] duration: 5.637422359s FAIL (2025-07-09 23:55:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.637447797s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 8.452483001s FAIL (2025-07-09 23:55:24 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 8.45250838s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...X.......X................................................] duration: 11.202269689s FAIL (2025-07-09 23:54:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.202294599s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 9.032377251s FAIL (2025-07-09 23:54:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 9.032398903s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 27.727209885s FAIL (2025-07-09 23:53:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 27.727243558s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....X.......X...............................................] duration: 5.730602497s FAIL (2025-07-09 23:53:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.730616314s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....X.......X..............................................] duration: 20.420132244s FAIL (2025-07-09 23:53:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 20.420150889s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......X.......X.............................................] duration: 9.287040103s FAIL (2025-07-09 23:53:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.28706013s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 13.554397933s FAIL (2025-07-09 23:53:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 13.554435614s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.848131848s FAIL (2025-07-09 23:52:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.848159221s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X............X..............................................] duration: 21.784131132s FAIL (2025-07-09 23:52:05 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 21.784158664s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......X.......X............................................] duration: 13.694277705s FAIL (2025-07-09 23:51:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 13.694295288s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........X.......X...........................................] duration: 6.703232177s FAIL (2025-07-09 23:51:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.70325471s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.X............X.............................................] duration: 15.225099449s FAIL (2025-07-09 23:51:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 15.225124988s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........X.......X..........................................] duration: 5.779325752s FAIL (2025-07-09 23:50:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.779346764s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..X............X............................................] duration: 35.173431117s FAIL (2025-07-09 23:50:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 35.173465453s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........X.......X.........................................] duration: 11.624980613s FAIL (2025-07-09 23:49:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.62500427s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........X.......X........................................] duration: 5.717308673s FAIL (2025-07-09 23:49:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.717329955s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...X............X...........................................] duration: 5.916267935s FAIL (2025-07-09 23:49:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.91629649s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............X.......X.......................................] duration: 10.509919909s FAIL (2025-07-09 23:49:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.50994603s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....X............X..........................................] duration: 20.882602435s FAIL (2025-07-09 23:48:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 20.882637282s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....X............X.........................................] duration: 6.018935065s FAIL (2025-07-09 23:47:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.01895909s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............X.......X......................................] duration: 5.612967194s FAIL (2025-07-09 23:47:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.612991912s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............X.......X.....................................] duration: 22.725720541s FAIL (2025-07-09 23:47:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 22.725745288s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......X............X........................................] duration: 11.635175728s FAIL (2025-07-09 23:47:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 11.635199895s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......X............X.......................................] duration: 6.271801956s FAIL (2025-07-09 23:46:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== uestItem_SegmentBegin Jul 9 23:12:42.134881962 (398h2m16.905523297s) [seg_pos={0 0}, upload=318452]: Begin upload segment... Jul 9 23:12:42.134950294 (398h2m16.905591629s) [seg_pos={0 0}, upload=318452]: Done begin upload segment. Jul 9 23:12:42.134981082 (398h2m16.905622417s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135020638 (398h2m16.905661983s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135575439 (398h2m16.906216774s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135895081 (398h2m16.906536416s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.135916562 (398h2m16.906557897s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136222628 (398h2m16.906863963s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136501170 (398h2m16.907142506s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136773411 (398h2m16.907414746s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.136994234 (398h2m16.907635559s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137216439 (398h2m16.907857774s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137458321 (398h2m16.908099656s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.137623086 (398h2m16.908264421s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138134475 (398h2m16.90877581s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138499122 (398h2m16.909140458s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138736497 (398h2m16.909377822s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.138951127 (398h2m16.909592452s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139222767 (398h2m16.909864102s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:42.139541577 (398h2m16.910182912s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Uploading piece... Jul 9 23:12:43.510699884 (398h2m18.28134122s) [upload=318452]: Next returned nil segment Jul 9 23:12:43.510713381 (398h2m18.281354716s) [upload=318452]: Waiting for error group managing segments... Jul 9 23:12:44.093679677 (398h2m18.864321012s) [noise=true , address=79.127.220.98:4399 , piece_id=JBYTJ2J2D7SM4H3RV3EQH5ABL4ZKNAIADKQK34F7QNCWEHYTSUWQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139156961 (398h2m18.909798286s) [noise=true , address=77.90.31.13:4635 , piece_id=FWYYW5PBLVBCDN7NVSBINFBXSEV4ILKI5C3V5PPPEBBDBNEBYN4A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139550674 (398h2m18.910192019s) [noise=true , address=77.90.31.16:4751 , piece_id=JW4FBKCDMFQTWPBDZMEFXRDEMIXYODHJE7HLM77MCRD4LFDXNZPQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.139723775 (398h2m18.91036512s) [noise=true , address=77.90.31.17:4798 , piece_id=TBDKFQBEJ7WT36EXSJG3P6PNW3XIZONBUZTOGTXY2VUFLF22REVQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.140606163 (398h2m18.911247489s) [noise=true , address=77.90.31.21:4903 , piece_id=R5QAKYLI5REVR225XMMC36NWZJUKA5OEYGGFXYSTEFM2AYULUA6A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.141871074 (398h2m18.912512409s) [noise=true , address=77.90.31.12:4614 , piece_id=NI2FQSAPIWR5MX7AFFEXYAQ7QRU2ZUJXOYVP5HWPQETSFDZ2KW4Q, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143296170 (398h2m18.913937495s) [noise=true , address=77.90.31.15:4707 , piece_id=DRQVQ2WANPEU45AEHTUG4NJ3L77HRJ6EAZA2VAGWNXIK7D52IMBQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:44.143572189 (398h2m18.914213524s) [noise=true , address=77.90.31.10:4544 , piece_id=RGK2KCBCURPJ4VCSVTJG3UDA6DRJ7FV3ZD4MI6RFLZJD4P5ZBT5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:45.311783220 (398h2m20.082424555s) [noise=true , address=79.127.201.215:4358 , piece_id=5CVNUXO5Y372KUW36TNVR3MC46O4E3ACKW5SX6SGW326XE37HBRA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:47.074380105 (398h2m21.84502144s) [noise=true , address=79.127.219.38:4026 , piece_id=A2UHMA5EFI43SAKWXDNQLL2PL3XPMNQTATSOJTIBXECPXRZRPOIA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:12:52.162572575 (398h2m26.93321391s) [noise=true , address=104.36.82.8:4980 , piece_id=SYG55RNPHNX4QPSLUD2RFJYJZSUR6LFINSBEZWJYSVW5XNLSEJSQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:13.763376135 (398h2m48.53401746s) [noise=true , address=45.91.95.2:4026 , piece_id=JGENHL3OPL53656GHVPHLIQBDXJJE5HTNTBBXESVVOSJJGFSLPCQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:29.504846258 (398h3m4.275487583s) [noise=true , address=104.36.82.19:4425 , piece_id=KU7X5R54DEHQI4P6MND6DBKFWQAEPBNL2WT7WWNPD67MC75MA73A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: <nil> Jul 9 23:13:41.049567150 (398h3m15.820208505s) [noise=true , address=104.36.82.17:4350 , piece_id=7S7QDNFA53XHNBTVWE4XBXB6WO3DEQVCITWIX6C7UVP4L4YIXQ5A, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg, address:104.36.82.17:4350): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049619941 (398h3m15.820261276s) [noise=true , address=104.36.82.23:4464 , piece_id=HKQ2EFJ5DDRTLMACCVLXHEH64IAY3KBCFATSKHKHY3TKG7ANW3UQ, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1mLbGHntspYmsTVg8433HYSdAEMrXjGnDhmmvX1JmmgcxtdLgk, address:104.36.82.23:4464): protocol: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43978->104.36.82.23:4464: use of closed network connection Jul 9 23:13:41.049694543 (398h3m15.820335878s) [noise=true , address=45.91.95.4:4023 , piece_id=CJSW4BYN6KT7AHN7NGCXY23JLGR6CMHTU722HSCGUKU46CG4BEWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:17SUmQEJJ3Qwe9yRq5DFTGaZBqGnz5Pu5YDri93Wk5NP3rcm5c, address:45.91.95.4:4023): protocol: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40226->45.91.95.4:4023: use of closed network connection Jul 9 23:13:41.049733979 (398h3m15.820375314s) [noise=true , address=45.91.95.3:4017 , piece_id=VH7DZMSQMOZ5365UHMZ5V3ZQXKI5DMTW24E7ZIWAKSLPWDZILVWA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1R6A6f6LTL3VDDg5gbhvQE55bRLJPDfAjViixeNX4KjVJpYFDE, address:45.91.95.3:4017): protocol: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48304->45.91.95.3:4017: use of closed network connection Jul 9 23:13:41.049758877 (398h3m15.820400212s) [noise=true , address=45.91.95.5:4025 , piece_id=FRE5AKNIJYUIZH5JCJFCJVP7V3K5NS4STFYI4YSZGEFZNCSVROFA, seg_pos={0 0}, upload=318452]: Done uploading piece. err: ecclient: upload failed (node:1m82Tdkxzub83FtYpd2Abhgf6StE1eFtxn1ESBi8BdHGGVhCu8, address:45.91.95.5:4025): protocol: expected piece hash; context deadline exceeded; EOF Jul 9 23:13:41.049823370 (398h3m15.820464705s) [seg_pos={0 0}, upload=318452]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 9 23:13:41.285661371 (398h3m16.056302706s) [upload=318452]: Done uploading segments... Jul 9 23:13:41.285688192 (398h3m16.056329517s) [upload=318452]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.271827476s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)