Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...........X............X...............X........X...X..XX..] duration:
17.766982003s
FAIL (2025-07-29 13:05:08 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 7)
Duration: 17.767011428s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [........................................................X.X.] duration:
20.95293687s
FAIL (2025-07-29 13:05:01 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
ding segments...
Jul 29 13:03:41.091320246 (20h17m53.567258701s) [upload=19386]: Got next segment. Inline: false
Jul 29 13:03:41.091349191 (20h17m53.567287656s) [upload=19386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:41.091354331 (20h17m53.567292796s) [upload=19386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:41.616444845 (20h17m54.09238331s) [seg_pos={0 0}, upload=19386]: Begin upload segment...
Jul 29 13:03:41.616487748 (20h17m54.092426213s) [seg_pos={0 0}, upload=19386]: Done begin upload segment.
Jul 29 13:03:41.616507376 (20h17m54.092445841s) [noise=true , address=104.36.82.15:4263 , piece_id=3GCLYN4UBCLM5BPLXDQT5SSWPJBTKIOZM4UIUNO3OZIXW6OANUBQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.616564315 (20h17m54.09250278s) [noise=true , address=104.36.82.11:4119 , piece_id=6KWLABSUMX6YVKD6LGKR6ONLQKFFTSTKFHHRVFIN7U4KDALBNCBQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.616866433 (20h17m54.092804888s) [noise=true , address=104.36.82.54:4175 , piece_id=5PAE3BM5AFSLZ5TVUQC3QK3RVWCVGFDLOK452BDPWQ7ARTL7EYWQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617072557 (20h17m54.093011022s) [noise=true , address=104.36.82.56:4242 , piece_id=BHKC5MH4G65BK2YLJJANIYZ4MLAUTMBG32XSRISARHCO26AZUXRA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617110629 (20h17m54.093049084s) [noise=true , address=104.36.82.5:4866 , piece_id=EFRLC4LA232NZZJU3GDSP2EEBZO3W2LGJRD3L2A6SPSRBTLUTIFA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617355037 (20h17m54.093293492s) [noise=true , address=104.36.82.61:4391 , piece_id=TI5YDGDSTWKDX5XAWL36F3TJDQNHKNTREZVTUGIS2EVZYP6DWSDA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617481549 (20h17m54.093420024s) [noise=true , address=104.36.82.20:4448 , piece_id=CSHYRDGTS4ROFDTKETIZ36TWJE3OEMAKLB4RGFAU557G725EANXQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617583044 (20h17m54.093521509s) [noise=true , address=104.36.82.47:4545 , piece_id=PZWVIOWLBZ72IOFRJHPAD4OZZPA2G4XYCDLGYEY7THSOR7XDHMUQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617828073 (20h17m54.093766528s) [noise=true , address=104.36.82.42:4802 , piece_id=6HORHYYKIKDX4IWWKUQPVGZQZ2YYIGC47OCZHRVBC4BZFRJX5TQQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617987597 (20h17m54.093926062s) [noise=true , address=104.36.82.13:4214 , piece_id=SLX3YJCEWCM3553VZHILH337FKSPPFNKVFTPXO4KIBOS6IXCLXHA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618055948 (20h17m54.093994403s) [noise=true , address=104.36.82.46:4500 , piece_id=VCYKKDSLEKTTL3KO2FJ4VA5JGIVPA4GFBBHH65HPFZTP4REUTHYQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618285828 (20h17m54.094224293s) [noise=true , address=104.36.82.52:4092 , piece_id=BMJCAQYXJCUVJTEXH52UXYLD4MHWLDGQTJIPDOFRF4LPLTT36ESA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618485871 (20h17m54.094424336s) [noise=true , address=104.36.82.10:4088 , piece_id=6IV2Z7FXDNEOBJMNPRG7WSPZWZTJ5CGDF6JHBSF7WCIIL2QQWFUA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618663881 (20h17m54.094602346s) [noise=true , address=104.36.82.51:4075 , piece_id=P5NU32M3V7AMYFZVJ6XZY5K2YMQWF4EULQGX6RRYWG6SWDWWAFMQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618840449 (20h17m54.094778914s) [noise=true , address=104.36.82.14:4227 , piece_id=O2FXJBOV3CJCKLZHRPBTLXX2QRT2OWJQ5HPNHZI5IVIFDVUUICVQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.619028879 (20h17m54.094967344s) [noise=true , address=104.36.82.9:4028 , piece_id=XCRNGUPBFYCZOYT23L6NHJ6WQR55TQMTWZF4SNKSRLQGC5TYO3LA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.619215837 (20h17m54.095154302s) [noise=true , address=104.36.82.53:4126 , piece_id=GZ5Z7AGMYVGYVUJAWFAIS6SQLRHFB772RLQY736QUGOXA5OWQ34Q, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.619408406 (20h17m54.095346871s) [noise=true , address=104.36.82.55:4219 , piece_id=IURHWONYUYYJWIL5BDF6HLCEPA76O6QAZAJ22NCI6LQYIGO6K4IA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:43.299790904 (20h17m55.775729369s) [upload=19386]: Next returned nil segment
Jul 29 13:03:43.299806024 (20h17m55.775744479s) [upload=19386]: Waiting for error group managing segments...
Jul 29 13:03:43.847040928 (20h17m56.322979393s) [noise=true , address=104.36.82.9:4028 , piece_id=XCRNGUPBFYCZOYT23L6NHJ6WQR55TQMTWZF4SNKSRLQGC5TYO3LA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:43.879495404 (20h17m56.355433869s) [noise=true , address=104.36.82.61:4391 , piece_id=TI5YDGDSTWKDX5XAWL36F3TJDQNHKNTREZVTUGIS2EVZYP6DWSDA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:46.350727192 (20h17m58.826665657s) [noise=true , address=104.36.82.5:4866 , piece_id=EFRLC4LA232NZZJU3GDSP2EEBZO3W2LGJRD3L2A6SPSRBTLUTIFA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:51.702944756 (20h18m4.178883221s) [noise=true , address=104.36.82.42:4802 , piece_id=6HORHYYKIKDX4IWWKUQPVGZQZ2YYIGC47OCZHRVBC4BZFRJX5TQQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:55.250827413 (20h18m7.726765878s) [noise=true , address=104.36.82.55:4219 , piece_id=IURHWONYUYYJWIL5BDF6HLCEPA76O6QAZAJ22NCI6LQYIGO6K4IA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:57.858469692 (20h18m10.334408157s) [noise=true , address=104.36.82.53:4126 , piece_id=GZ5Z7AGMYVGYVUJAWFAIS6SQLRHFB772RLQY736QUGOXA5OWQ34Q, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:59.265385056 (20h18m11.741323511s) [noise=true , address=104.36.82.10:4088 , piece_id=6IV2Z7FXDNEOBJMNPRG7WSPZWZTJ5CGDF6JHBSF7WCIIL2QQWFUA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:59.973580263 (20h18m12.449518729s) [noise=true , address=104.36.82.11:4119 , piece_id=6KWLABSUMX6YVKD6LGKR6ONLQKFFTSTKFHHRVFIN7U4KDALBNCBQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:16.002200978 (20h18m28.478139453s) [noise=true , address=104.36.82.52:4092 , piece_id=BMJCAQYXJCUVJTEXH52UXYLD4MHWLDGQTJIPDOFRF4LPLTT36ESA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:30.906580908 (20h18m43.382519373s) [noise=true , address=104.36.82.20:4448 , piece_id=CSHYRDGTS4ROFDTKETIZ36TWJE3OEMAKLB4RGFAU557G725EANXQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:31.164952501 (20h18m43.640890966s) [noise=true , address=104.36.82.14:4227 , piece_id=O2FXJBOV3CJCKLZHRPBTLXX2QRT2OWJQ5HPNHZI5IVIFDVUUICVQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:33.000876204 (20h18m45.476814679s) [noise=true , address=104.36.82.56:4242 , piece_id=BHKC5MH4G65BK2YLJJANIYZ4MLAUTMBG32XSRISARHCO26AZUXRA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:34.725342452 (20h18m47.201280907s) [noise=true , address=104.36.82.47:4545 , piece_id=PZWVIOWLBZ72IOFRJHPAD4OZZPA2G4XYCDLGYEY7THSOR7XDHMUQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:40.451024021 (20h18m52.926962486s) [noise=true , address=104.36.82.46:4500 , piece_id=VCYKKDSLEKTTL3KO2FJ4VA5JGIVPA4GFBBHH65HPFZTP4REUTHYQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:12B7ox4ehqxJ2mwqeXj8C9N9GuSU5etNC23iT1pJnTgMLGBAGQK, address:104.36.82.46:4500): protocol: write tcp 188.166.225.170:46700->104.36.82.46:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451060500 (20h18m52.926998965s) [noise=true , address=104.36.82.51:4075 , piece_id=P5NU32M3V7AMYFZVJ6XZY5K2YMQWF4EULQGX6RRYWG6SWDWWAFMQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:1eTSSYh294r2TyToU22xzVunbLwXwbaVJopvF5ej8RxaDLdbtK, address:104.36.82.51:4075): protocol: write tcp 188.166.225.170:41162->104.36.82.51:4075: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451086179 (20h18m52.927024644s) [noise=true , address=104.36.82.54:4175 , piece_id=5PAE3BM5AFSLZ5TVUQC3QK3RVWCVGFDLOK452BDPWQ7ARTL7EYWQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:12ou7jwFyJP3mNoALddniUTDT9duVyQKZjeq4xHCyx6sRWpwEPJ, address:104.36.82.54:4175): protocol: rpc: dial tcp 104.36.82.54:4175: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451120024 (20h18m52.927058489s) [noise=true , address=104.36.82.13:4214 , piece_id=SLX3YJCEWCM3553VZHILH337FKSPPFNKVFTPXO4KIBOS6IXCLXHA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay, address:104.36.82.13:4214): protocol: rpc: dial tcp 104.36.82.13:4214: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451147116 (20h18m52.927085581s) [noise=true , address=104.36.82.15:4263 , piece_id=3GCLYN4UBCLM5BPLXDQT5SSWPJBTKIOZM4UIUNO3OZIXW6OANUBQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:1f97yBEvcrYHqMq7iovVoju77jzhUYgoQCsUGULeTagugFXrCu, address:104.36.82.15:4263): protocol: write tcp 188.166.225.170:39380->104.36.82.15:4263: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451167805 (20h18m52.927106271s) [seg_pos={0 0}, upload=19386]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 29 13:04:40.696628655 (20h18m53.17256714s) [upload=19386]: Done uploading segments...
Jul 29 13:04:40.696658391 (20h18m53.172596856s) [upload=19386]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 20.952958612s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [............X............X...............X........X...X..XX.] duration:
22.666119485s
FAIL (2025-07-29 13:04:46 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 7)
Duration: 22.666149172s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................X.X] duration:
1m0.247653232s
FAIL (2025-07-29 13:04:40 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
ding segments...
Jul 29 13:03:41.091320246 (20h17m53.567258701s) [upload=19386]: Got next segment. Inline: false
Jul 29 13:03:41.091349191 (20h17m53.567287656s) [upload=19386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:41.091354331 (20h17m53.567292796s) [upload=19386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:41.616444845 (20h17m54.09238331s) [seg_pos={0 0}, upload=19386]: Begin upload segment...
Jul 29 13:03:41.616487748 (20h17m54.092426213s) [seg_pos={0 0}, upload=19386]: Done begin upload segment.
Jul 29 13:03:41.616507376 (20h17m54.092445841s) [noise=true , address=104.36.82.15:4263 , piece_id=3GCLYN4UBCLM5BPLXDQT5SSWPJBTKIOZM4UIUNO3OZIXW6OANUBQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.616564315 (20h17m54.09250278s) [noise=true , address=104.36.82.11:4119 , piece_id=6KWLABSUMX6YVKD6LGKR6ONLQKFFTSTKFHHRVFIN7U4KDALBNCBQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.616866433 (20h17m54.092804888s) [noise=true , address=104.36.82.54:4175 , piece_id=5PAE3BM5AFSLZ5TVUQC3QK3RVWCVGFDLOK452BDPWQ7ARTL7EYWQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617072557 (20h17m54.093011022s) [noise=true , address=104.36.82.56:4242 , piece_id=BHKC5MH4G65BK2YLJJANIYZ4MLAUTMBG32XSRISARHCO26AZUXRA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617110629 (20h17m54.093049084s) [noise=true , address=104.36.82.5:4866 , piece_id=EFRLC4LA232NZZJU3GDSP2EEBZO3W2LGJRD3L2A6SPSRBTLUTIFA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617355037 (20h17m54.093293492s) [noise=true , address=104.36.82.61:4391 , piece_id=TI5YDGDSTWKDX5XAWL36F3TJDQNHKNTREZVTUGIS2EVZYP6DWSDA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617481549 (20h17m54.093420024s) [noise=true , address=104.36.82.20:4448 , piece_id=CSHYRDGTS4ROFDTKETIZ36TWJE3OEMAKLB4RGFAU557G725EANXQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617583044 (20h17m54.093521509s) [noise=true , address=104.36.82.47:4545 , piece_id=PZWVIOWLBZ72IOFRJHPAD4OZZPA2G4XYCDLGYEY7THSOR7XDHMUQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617828073 (20h17m54.093766528s) [noise=true , address=104.36.82.42:4802 , piece_id=6HORHYYKIKDX4IWWKUQPVGZQZ2YYIGC47OCZHRVBC4BZFRJX5TQQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.617987597 (20h17m54.093926062s) [noise=true , address=104.36.82.13:4214 , piece_id=SLX3YJCEWCM3553VZHILH337FKSPPFNKVFTPXO4KIBOS6IXCLXHA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618055948 (20h17m54.093994403s) [noise=true , address=104.36.82.46:4500 , piece_id=VCYKKDSLEKTTL3KO2FJ4VA5JGIVPA4GFBBHH65HPFZTP4REUTHYQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618285828 (20h17m54.094224293s) [noise=true , address=104.36.82.52:4092 , piece_id=BMJCAQYXJCUVJTEXH52UXYLD4MHWLDGQTJIPDOFRF4LPLTT36ESA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618485871 (20h17m54.094424336s) [noise=true , address=104.36.82.10:4088 , piece_id=6IV2Z7FXDNEOBJMNPRG7WSPZWZTJ5CGDF6JHBSF7WCIIL2QQWFUA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618663881 (20h17m54.094602346s) [noise=true , address=104.36.82.51:4075 , piece_id=P5NU32M3V7AMYFZVJ6XZY5K2YMQWF4EULQGX6RRYWG6SWDWWAFMQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.618840449 (20h17m54.094778914s) [noise=true , address=104.36.82.14:4227 , piece_id=O2FXJBOV3CJCKLZHRPBTLXX2QRT2OWJQ5HPNHZI5IVIFDVUUICVQ, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.619028879 (20h17m54.094967344s) [noise=true , address=104.36.82.9:4028 , piece_id=XCRNGUPBFYCZOYT23L6NHJ6WQR55TQMTWZF4SNKSRLQGC5TYO3LA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.619215837 (20h17m54.095154302s) [noise=true , address=104.36.82.53:4126 , piece_id=GZ5Z7AGMYVGYVUJAWFAIS6SQLRHFB772RLQY736QUGOXA5OWQ34Q, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:41.619408406 (20h17m54.095346871s) [noise=true , address=104.36.82.55:4219 , piece_id=IURHWONYUYYJWIL5BDF6HLCEPA76O6QAZAJ22NCI6LQYIGO6K4IA, seg_pos={0 0}, upload=19386]: Uploading piece...
Jul 29 13:03:43.299790904 (20h17m55.775729369s) [upload=19386]: Next returned nil segment
Jul 29 13:03:43.299806024 (20h17m55.775744479s) [upload=19386]: Waiting for error group managing segments...
Jul 29 13:03:43.847040928 (20h17m56.322979393s) [noise=true , address=104.36.82.9:4028 , piece_id=XCRNGUPBFYCZOYT23L6NHJ6WQR55TQMTWZF4SNKSRLQGC5TYO3LA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:43.879495404 (20h17m56.355433869s) [noise=true , address=104.36.82.61:4391 , piece_id=TI5YDGDSTWKDX5XAWL36F3TJDQNHKNTREZVTUGIS2EVZYP6DWSDA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:46.350727192 (20h17m58.826665657s) [noise=true , address=104.36.82.5:4866 , piece_id=EFRLC4LA232NZZJU3GDSP2EEBZO3W2LGJRD3L2A6SPSRBTLUTIFA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:51.702944756 (20h18m4.178883221s) [noise=true , address=104.36.82.42:4802 , piece_id=6HORHYYKIKDX4IWWKUQPVGZQZ2YYIGC47OCZHRVBC4BZFRJX5TQQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:55.250827413 (20h18m7.726765878s) [noise=true , address=104.36.82.55:4219 , piece_id=IURHWONYUYYJWIL5BDF6HLCEPA76O6QAZAJ22NCI6LQYIGO6K4IA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:57.858469692 (20h18m10.334408157s) [noise=true , address=104.36.82.53:4126 , piece_id=GZ5Z7AGMYVGYVUJAWFAIS6SQLRHFB772RLQY736QUGOXA5OWQ34Q, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:59.265385056 (20h18m11.741323511s) [noise=true , address=104.36.82.10:4088 , piece_id=6IV2Z7FXDNEOBJMNPRG7WSPZWZTJ5CGDF6JHBSF7WCIIL2QQWFUA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:03:59.973580263 (20h18m12.449518729s) [noise=true , address=104.36.82.11:4119 , piece_id=6KWLABSUMX6YVKD6LGKR6ONLQKFFTSTKFHHRVFIN7U4KDALBNCBQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:16.002200978 (20h18m28.478139453s) [noise=true , address=104.36.82.52:4092 , piece_id=BMJCAQYXJCUVJTEXH52UXYLD4MHWLDGQTJIPDOFRF4LPLTT36ESA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:30.906580908 (20h18m43.382519373s) [noise=true , address=104.36.82.20:4448 , piece_id=CSHYRDGTS4ROFDTKETIZ36TWJE3OEMAKLB4RGFAU557G725EANXQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:31.164952501 (20h18m43.640890966s) [noise=true , address=104.36.82.14:4227 , piece_id=O2FXJBOV3CJCKLZHRPBTLXX2QRT2OWJQ5HPNHZI5IVIFDVUUICVQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:33.000876204 (20h18m45.476814679s) [noise=true , address=104.36.82.56:4242 , piece_id=BHKC5MH4G65BK2YLJJANIYZ4MLAUTMBG32XSRISARHCO26AZUXRA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:34.725342452 (20h18m47.201280907s) [noise=true , address=104.36.82.47:4545 , piece_id=PZWVIOWLBZ72IOFRJHPAD4OZZPA2G4XYCDLGYEY7THSOR7XDHMUQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: <nil>
Jul 29 13:04:40.451024021 (20h18m52.926962486s) [noise=true , address=104.36.82.46:4500 , piece_id=VCYKKDSLEKTTL3KO2FJ4VA5JGIVPA4GFBBHH65HPFZTP4REUTHYQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:12B7ox4ehqxJ2mwqeXj8C9N9GuSU5etNC23iT1pJnTgMLGBAGQK, address:104.36.82.46:4500): protocol: write tcp 188.166.225.170:46700->104.36.82.46:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451060500 (20h18m52.926998965s) [noise=true , address=104.36.82.51:4075 , piece_id=P5NU32M3V7AMYFZVJ6XZY5K2YMQWF4EULQGX6RRYWG6SWDWWAFMQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:1eTSSYh294r2TyToU22xzVunbLwXwbaVJopvF5ej8RxaDLdbtK, address:104.36.82.51:4075): protocol: write tcp 188.166.225.170:41162->104.36.82.51:4075: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451086179 (20h18m52.927024644s) [noise=true , address=104.36.82.54:4175 , piece_id=5PAE3BM5AFSLZ5TVUQC3QK3RVWCVGFDLOK452BDPWQ7ARTL7EYWQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:12ou7jwFyJP3mNoALddniUTDT9duVyQKZjeq4xHCyx6sRWpwEPJ, address:104.36.82.54:4175): protocol: rpc: dial tcp 104.36.82.54:4175: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451120024 (20h18m52.927058489s) [noise=true , address=104.36.82.13:4214 , piece_id=SLX3YJCEWCM3553VZHILH337FKSPPFNKVFTPXO4KIBOS6IXCLXHA, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay, address:104.36.82.13:4214): protocol: rpc: dial tcp 104.36.82.13:4214: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451147116 (20h18m52.927085581s) [noise=true , address=104.36.82.15:4263 , piece_id=3GCLYN4UBCLM5BPLXDQT5SSWPJBTKIOZM4UIUNO3OZIXW6OANUBQ, seg_pos={0 0}, upload=19386]: Done uploading piece. err: ecclient: upload failed (node:1f97yBEvcrYHqMq7iovVoju77jzhUYgoQCsUGULeTagugFXrCu, address:104.36.82.15:4263): protocol: write tcp 188.166.225.170:39380->104.36.82.15:4263: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:40.451167805 (20h18m52.927106271s) [seg_pos={0 0}, upload=19386]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 29 13:04:40.696628655 (20h18m53.17256714s) [upload=19386]: Done uploading segments...
Jul 29 13:04:40.696658391 (20h18m53.172596856s) [upload=19386]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.247665185s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.............X............X...............X........X...X..XX] duration:
30.256855765s
FAIL (2025-07-29 13:04:14 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 7)
Duration: 30.256882457s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............XX............X...........X...................] duration:
1.835778544s
FAIL (2025-07-29 13:04:10 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.835800416s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
29.059754375s
FAIL (2025-07-29 13:03:40 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
1.401308984s) [upload=19362]: Done starting upload
Jul 29 13:01:58.925488424 (20h16m11.401426879s) [upload=19362]: Uploading segments...
Jul 29 13:01:58.925576724 (20h16m11.401515189s) [upload=19362]: Got next segment. Inline: false
Jul 29 13:01:58.925604367 (20h16m11.401542832s) [upload=19362]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:01:58.925609076 (20h16m11.401547531s) [upload=19362]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:01:59.374179613 (20h16m11.850118078s) [seg_pos={0 0}, upload=19362]: Begin upload segment...
Jul 29 13:01:59.374228737 (20h16m11.850167202s) [seg_pos={0 0}, upload=19362]: Done begin upload segment.
Jul 29 13:01:59.374252723 (20h16m11.850191178s) [noise=true , address=104.36.82.52:4095 , piece_id=E2PAP5UJ55OMCTBW2FXUBZPX6436ZC6W2NCOBQLF2AV5R3ELP2OQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.374280937 (20h16m11.850219402s) [noise=true , address=104.36.82.20:4460 , piece_id=EMMJGFVGDPLLEJ2654K3BFPNTZXFEDP52VNPBEESZ2ASNXGSY77Q, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.374590579 (20h16m11.850529034s) [noise=true , address=104.36.82.2:4749 , piece_id=IVZ63VD2JSYTQXYUT54N72TFE4MVCJTUYHQXOUKZ2MPEMG6ZZRGA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.374685661 (20h16m11.850624127s) [noise=true , address=104.36.82.42:4800 , piece_id=4A6U2GZBNSV3SWEB7WDYGWNY4HQHCLUOF72F43EU56LG2AVVCNZA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.374977419 (20h16m11.850915884s) [noise=true , address=104.36.82.46:4500 , piece_id=75XC7R7N5B3IEZBFRUVC7RTB5QNDK2QJUL3YAGTFLIFRMFKB7PSQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.375280168 (20h16m11.851218623s) [noise=true , address=104.36.82.15:4283 , piece_id=W2ZEXCHNDVM3O3K3RZOVOX67BO4PSMJQX5BBTZR76GT6F4VKYKTQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.375593268 (20h16m11.851531733s) [noise=true , address=104.36.82.14:4242 , piece_id=SS4HWFIS2IXIVSWDKKAWKB7KDHOH7HTM56AMSBMIGOAPWLN2QIVQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.375905184 (20h16m11.85184365s) [noise=true , address=104.36.82.41:4770 , piece_id=5K6PJZKVJ5W2NDUZNMGGZKFMLT57QFO6NORQTQOHCNKPJXPOHJVQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.376131688 (20h16m11.852070143s) [noise=true , address=104.36.82.59:4333 , piece_id=V2LP27G7HZ3VWTRASZ5KS27W4IIZOU6AP7RKTQPHKV6DEOFR6EBA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.376388790 (20h16m11.852327255s) [noise=true , address=104.36.82.13:4200 , piece_id=NBBV3V5ZGSDKIOWHZ5ELHW7VH4KUMNI56ZEWA5SWQQS5PU24QJOQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.376605645 (20h16m11.85254411s) [noise=true , address=104.36.82.47:4531 , piece_id=EERLNNAFJDQZJ7NHPEZSYLNFFDMRZEZVBSVCLOW45RLLFKEZ24JA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.376813402 (20h16m11.852751867s) [noise=true , address=104.36.82.16:4324 , piece_id=KHY5U5GX5IIFAQZMYIFM36LBMCQ3MACXSBK2BURZE6GQTNT3UOOA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377018715 (20h16m11.852957181s) [noise=true , address=104.36.82.46:4487 , piece_id=LYFX3N3W5NLQYLSURCNQF3PJRCOX4CPVWT4VD2AFOGYFSDS5ZQFA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377278482 (20h16m11.853216937s) [noise=true , address=104.36.82.12:4164 , piece_id=NWBMLJP5NAJBPGO5Z7AAU4JI5PFPCPU6Q5ASYSU7VTWTCTPANEFQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377484326 (20h16m11.853422781s) [noise=true , address=104.36.82.3:4775 , piece_id=ZMLOMD2AFM2X2QYRA3J2VT7MN25KG3VQ5N3L2HAYLYD7NQZRLSAQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377702394 (20h16m11.853640859s) [noise=true , address=104.36.82.53:4142 , piece_id=JMVTWSR3A34JBZNI7X3CUZB75657P4RNW6WRUD2XCMD4RCQ7WMOA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377917395 (20h16m11.85385586s) [noise=true , address=104.36.82.56:4247 , piece_id=O3AQ23HEMW6KQ733OPHHJDRWYRXGO32VA42HHJAMZ74ZX5OK4BYA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.378129080 (20h16m11.854067535s) [noise=true , address=104.36.82.11:4121 , piece_id=NO53XBMRZQDNQIHYELIKD6LG3T24KGKRJV4FSZ2EOBDBZKHRCB7A, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:02:00.998263383 (20h16m13.474201848s) [upload=19362]: Next returned nil segment
Jul 29 13:02:00.998280526 (20h16m13.474218991s) [upload=19362]: Waiting for error group managing segments...
Jul 29 13:02:01.419803493 (20h16m13.895741968s) [noise=true , address=104.36.82.13:4200 , piece_id=NBBV3V5ZGSDKIOWHZ5ELHW7VH4KUMNI56ZEWA5SWQQS5PU24QJOQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:01.480878329 (20h16m13.956816804s) [noise=true , address=104.36.82.56:4247 , piece_id=O3AQ23HEMW6KQ733OPHHJDRWYRXGO32VA42HHJAMZ74ZX5OK4BYA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:01.789321396 (20h16m14.265259871s) [noise=true , address=104.36.82.15:4283 , piece_id=W2ZEXCHNDVM3O3K3RZOVOX67BO4PSMJQX5BBTZR76GT6F4VKYKTQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:03.186940184 (20h16m15.662878649s) [noise=true , address=104.36.82.14:4242 , piece_id=SS4HWFIS2IXIVSWDKKAWKB7KDHOH7HTM56AMSBMIGOAPWLN2QIVQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:04.891455907 (20h16m17.367394372s) [noise=true , address=104.36.82.12:4164 , piece_id=NWBMLJP5NAJBPGO5Z7AAU4JI5PFPCPU6Q5ASYSU7VTWTCTPANEFQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:05.019732773 (20h16m17.495671238s) [noise=true , address=104.36.82.11:4121 , piece_id=NO53XBMRZQDNQIHYELIKD6LG3T24KGKRJV4FSZ2EOBDBZKHRCB7A, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:05.284485484 (20h16m17.76042395s) [noise=true , address=104.36.82.42:4800 , piece_id=4A6U2GZBNSV3SWEB7WDYGWNY4HQHCLUOF72F43EU56LG2AVVCNZA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:06.174594573 (20h16m18.650533038s) [noise=true , address=104.36.82.2:4749 , piece_id=IVZ63VD2JSYTQXYUT54N72TFE4MVCJTUYHQXOUKZ2MPEMG6ZZRGA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:08.975969507 (20h16m21.451907972s) [noise=true , address=104.36.82.20:4460 , piece_id=EMMJGFVGDPLLEJ2654K3BFPNTZXFEDP52VNPBEESZ2ASNXGSY77Q, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:09.352565052 (20h16m21.828503517s) [noise=true , address=104.36.82.3:4775 , piece_id=ZMLOMD2AFM2X2QYRA3J2VT7MN25KG3VQ5N3L2HAYLYD7NQZRLSAQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:11.461046619 (20h16m23.936985084s) [noise=true , address=104.36.82.53:4142 , piece_id=JMVTWSR3A34JBZNI7X3CUZB75657P4RNW6WRUD2XCMD4RCQ7WMOA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:13.048775372 (20h16m25.524713837s) [noise=true , address=104.36.82.41:4770 , piece_id=5K6PJZKVJ5W2NDUZNMGGZKFMLT57QFO6NORQTQOHCNKPJXPOHJVQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:19.258847112 (20h16m31.734785578s) [noise=true , address=104.36.82.59:4333 , piece_id=V2LP27G7HZ3VWTRASZ5KS27W4IIZOU6AP7RKTQPHKV6DEOFR6EBA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:58.277132366 (20h17m10.753070831s) [noise=true , address=104.36.82.47:4531 , piece_id=EERLNNAFJDQZJ7NHPEZSYLNFFDMRZEZVBSVCLOW45RLLFKEZ24JA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:12LZprfyqfD2YUwgAarzyjbgHEb6jMhAMAday5C45xk3j9RUS4u, address:104.36.82.47:4531): protocol: rpc: dial tcp 104.36.82.47:4531: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277312931 (20h17m10.753251396s) [noise=true , address=104.36.82.16:4324 , piece_id=KHY5U5GX5IIFAQZMYIFM36LBMCQ3MACXSBK2BURZE6GQTNT3UOOA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga, address:104.36.82.16:4324): protocol: rpc: dial tcp 104.36.82.16:4324: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277384939 (20h17m10.753323405s) [noise=true , address=104.36.82.46:4487 , piece_id=LYFX3N3W5NLQYLSURCNQF3PJRCOX4CPVWT4VD2AFOGYFSDS5ZQFA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX, address:104.36.82.46:4487): protocol: rpc: dial tcp 104.36.82.46:4487: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277449493 (20h17m10.753387958s) [noise=true , address=104.36.82.52:4095 , piece_id=E2PAP5UJ55OMCTBW2FXUBZPX6436ZC6W2NCOBQLF2AV5R3ELP2OQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:1idvNc8SGRP7tkAckr2TLv7LnvftiRUTGcwy5GCrH5rVyDEK5N, address:104.36.82.52:4095): protocol: rpc: dial tcp 104.36.82.52:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277487155 (20h17m10.75342562s) [noise=true , address=104.36.82.46:4500 , piece_id=75XC7R7N5B3IEZBFRUVC7RTB5QNDK2QJUL3YAGTFLIFRMFKB7PSQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:12B7ox4ehqxJ2mwqeXj8C9N9GuSU5etNC23iT1pJnTgMLGBAGQK, address:104.36.82.46:4500): protocol: rpc: dial tcp 104.36.82.46:4500: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277519126 (20h17m10.753457591s) [seg_pos={0 0}, upload=19362]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 29 13:02:58.506129815 (20h17m10.98206828s) [upload=19362]: Done uploading segments...
Jul 29 13:02:58.506160173 (20h17m10.982098648s) [upload=19362]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 29.059786496s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............XX............X...........X..................] duration:
1.841931048s
FAIL (2025-07-29 13:03:32 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.841954213s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..............X............X...............X........X...X..X] duration:
30.652985188s
FAIL (2025-07-29 13:03:28 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 30.653010776s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.23106509s
FAIL (2025-07-29 13:02:58 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
1.401308984s) [upload=19362]: Done starting upload
Jul 29 13:01:58.925488424 (20h16m11.401426879s) [upload=19362]: Uploading segments...
Jul 29 13:01:58.925576724 (20h16m11.401515189s) [upload=19362]: Got next segment. Inline: false
Jul 29 13:01:58.925604367 (20h16m11.401542832s) [upload=19362]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:01:58.925609076 (20h16m11.401547531s) [upload=19362]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:01:59.374179613 (20h16m11.850118078s) [seg_pos={0 0}, upload=19362]: Begin upload segment...
Jul 29 13:01:59.374228737 (20h16m11.850167202s) [seg_pos={0 0}, upload=19362]: Done begin upload segment.
Jul 29 13:01:59.374252723 (20h16m11.850191178s) [noise=true , address=104.36.82.52:4095 , piece_id=E2PAP5UJ55OMCTBW2FXUBZPX6436ZC6W2NCOBQLF2AV5R3ELP2OQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.374280937 (20h16m11.850219402s) [noise=true , address=104.36.82.20:4460 , piece_id=EMMJGFVGDPLLEJ2654K3BFPNTZXFEDP52VNPBEESZ2ASNXGSY77Q, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.374590579 (20h16m11.850529034s) [noise=true , address=104.36.82.2:4749 , piece_id=IVZ63VD2JSYTQXYUT54N72TFE4MVCJTUYHQXOUKZ2MPEMG6ZZRGA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.374685661 (20h16m11.850624127s) [noise=true , address=104.36.82.42:4800 , piece_id=4A6U2GZBNSV3SWEB7WDYGWNY4HQHCLUOF72F43EU56LG2AVVCNZA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.374977419 (20h16m11.850915884s) [noise=true , address=104.36.82.46:4500 , piece_id=75XC7R7N5B3IEZBFRUVC7RTB5QNDK2QJUL3YAGTFLIFRMFKB7PSQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.375280168 (20h16m11.851218623s) [noise=true , address=104.36.82.15:4283 , piece_id=W2ZEXCHNDVM3O3K3RZOVOX67BO4PSMJQX5BBTZR76GT6F4VKYKTQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.375593268 (20h16m11.851531733s) [noise=true , address=104.36.82.14:4242 , piece_id=SS4HWFIS2IXIVSWDKKAWKB7KDHOH7HTM56AMSBMIGOAPWLN2QIVQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.375905184 (20h16m11.85184365s) [noise=true , address=104.36.82.41:4770 , piece_id=5K6PJZKVJ5W2NDUZNMGGZKFMLT57QFO6NORQTQOHCNKPJXPOHJVQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.376131688 (20h16m11.852070143s) [noise=true , address=104.36.82.59:4333 , piece_id=V2LP27G7HZ3VWTRASZ5KS27W4IIZOU6AP7RKTQPHKV6DEOFR6EBA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.376388790 (20h16m11.852327255s) [noise=true , address=104.36.82.13:4200 , piece_id=NBBV3V5ZGSDKIOWHZ5ELHW7VH4KUMNI56ZEWA5SWQQS5PU24QJOQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.376605645 (20h16m11.85254411s) [noise=true , address=104.36.82.47:4531 , piece_id=EERLNNAFJDQZJ7NHPEZSYLNFFDMRZEZVBSVCLOW45RLLFKEZ24JA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.376813402 (20h16m11.852751867s) [noise=true , address=104.36.82.16:4324 , piece_id=KHY5U5GX5IIFAQZMYIFM36LBMCQ3MACXSBK2BURZE6GQTNT3UOOA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377018715 (20h16m11.852957181s) [noise=true , address=104.36.82.46:4487 , piece_id=LYFX3N3W5NLQYLSURCNQF3PJRCOX4CPVWT4VD2AFOGYFSDS5ZQFA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377278482 (20h16m11.853216937s) [noise=true , address=104.36.82.12:4164 , piece_id=NWBMLJP5NAJBPGO5Z7AAU4JI5PFPCPU6Q5ASYSU7VTWTCTPANEFQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377484326 (20h16m11.853422781s) [noise=true , address=104.36.82.3:4775 , piece_id=ZMLOMD2AFM2X2QYRA3J2VT7MN25KG3VQ5N3L2HAYLYD7NQZRLSAQ, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377702394 (20h16m11.853640859s) [noise=true , address=104.36.82.53:4142 , piece_id=JMVTWSR3A34JBZNI7X3CUZB75657P4RNW6WRUD2XCMD4RCQ7WMOA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.377917395 (20h16m11.85385586s) [noise=true , address=104.36.82.56:4247 , piece_id=O3AQ23HEMW6KQ733OPHHJDRWYRXGO32VA42HHJAMZ74ZX5OK4BYA, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:01:59.378129080 (20h16m11.854067535s) [noise=true , address=104.36.82.11:4121 , piece_id=NO53XBMRZQDNQIHYELIKD6LG3T24KGKRJV4FSZ2EOBDBZKHRCB7A, seg_pos={0 0}, upload=19362]: Uploading piece...
Jul 29 13:02:00.998263383 (20h16m13.474201848s) [upload=19362]: Next returned nil segment
Jul 29 13:02:00.998280526 (20h16m13.474218991s) [upload=19362]: Waiting for error group managing segments...
Jul 29 13:02:01.419803493 (20h16m13.895741968s) [noise=true , address=104.36.82.13:4200 , piece_id=NBBV3V5ZGSDKIOWHZ5ELHW7VH4KUMNI56ZEWA5SWQQS5PU24QJOQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:01.480878329 (20h16m13.956816804s) [noise=true , address=104.36.82.56:4247 , piece_id=O3AQ23HEMW6KQ733OPHHJDRWYRXGO32VA42HHJAMZ74ZX5OK4BYA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:01.789321396 (20h16m14.265259871s) [noise=true , address=104.36.82.15:4283 , piece_id=W2ZEXCHNDVM3O3K3RZOVOX67BO4PSMJQX5BBTZR76GT6F4VKYKTQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:03.186940184 (20h16m15.662878649s) [noise=true , address=104.36.82.14:4242 , piece_id=SS4HWFIS2IXIVSWDKKAWKB7KDHOH7HTM56AMSBMIGOAPWLN2QIVQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:04.891455907 (20h16m17.367394372s) [noise=true , address=104.36.82.12:4164 , piece_id=NWBMLJP5NAJBPGO5Z7AAU4JI5PFPCPU6Q5ASYSU7VTWTCTPANEFQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:05.019732773 (20h16m17.495671238s) [noise=true , address=104.36.82.11:4121 , piece_id=NO53XBMRZQDNQIHYELIKD6LG3T24KGKRJV4FSZ2EOBDBZKHRCB7A, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:05.284485484 (20h16m17.76042395s) [noise=true , address=104.36.82.42:4800 , piece_id=4A6U2GZBNSV3SWEB7WDYGWNY4HQHCLUOF72F43EU56LG2AVVCNZA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:06.174594573 (20h16m18.650533038s) [noise=true , address=104.36.82.2:4749 , piece_id=IVZ63VD2JSYTQXYUT54N72TFE4MVCJTUYHQXOUKZ2MPEMG6ZZRGA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:08.975969507 (20h16m21.451907972s) [noise=true , address=104.36.82.20:4460 , piece_id=EMMJGFVGDPLLEJ2654K3BFPNTZXFEDP52VNPBEESZ2ASNXGSY77Q, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:09.352565052 (20h16m21.828503517s) [noise=true , address=104.36.82.3:4775 , piece_id=ZMLOMD2AFM2X2QYRA3J2VT7MN25KG3VQ5N3L2HAYLYD7NQZRLSAQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:11.461046619 (20h16m23.936985084s) [noise=true , address=104.36.82.53:4142 , piece_id=JMVTWSR3A34JBZNI7X3CUZB75657P4RNW6WRUD2XCMD4RCQ7WMOA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:13.048775372 (20h16m25.524713837s) [noise=true , address=104.36.82.41:4770 , piece_id=5K6PJZKVJ5W2NDUZNMGGZKFMLT57QFO6NORQTQOHCNKPJXPOHJVQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:19.258847112 (20h16m31.734785578s) [noise=true , address=104.36.82.59:4333 , piece_id=V2LP27G7HZ3VWTRASZ5KS27W4IIZOU6AP7RKTQPHKV6DEOFR6EBA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: <nil>
Jul 29 13:02:58.277132366 (20h17m10.753070831s) [noise=true , address=104.36.82.47:4531 , piece_id=EERLNNAFJDQZJ7NHPEZSYLNFFDMRZEZVBSVCLOW45RLLFKEZ24JA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:12LZprfyqfD2YUwgAarzyjbgHEb6jMhAMAday5C45xk3j9RUS4u, address:104.36.82.47:4531): protocol: rpc: dial tcp 104.36.82.47:4531: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277312931 (20h17m10.753251396s) [noise=true , address=104.36.82.16:4324 , piece_id=KHY5U5GX5IIFAQZMYIFM36LBMCQ3MACXSBK2BURZE6GQTNT3UOOA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga, address:104.36.82.16:4324): protocol: rpc: dial tcp 104.36.82.16:4324: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277384939 (20h17m10.753323405s) [noise=true , address=104.36.82.46:4487 , piece_id=LYFX3N3W5NLQYLSURCNQF3PJRCOX4CPVWT4VD2AFOGYFSDS5ZQFA, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX, address:104.36.82.46:4487): protocol: rpc: dial tcp 104.36.82.46:4487: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277449493 (20h17m10.753387958s) [noise=true , address=104.36.82.52:4095 , piece_id=E2PAP5UJ55OMCTBW2FXUBZPX6436ZC6W2NCOBQLF2AV5R3ELP2OQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:1idvNc8SGRP7tkAckr2TLv7LnvftiRUTGcwy5GCrH5rVyDEK5N, address:104.36.82.52:4095): protocol: rpc: dial tcp 104.36.82.52:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277487155 (20h17m10.75342562s) [noise=true , address=104.36.82.46:4500 , piece_id=75XC7R7N5B3IEZBFRUVC7RTB5QNDK2QJUL3YAGTFLIFRMFKB7PSQ, seg_pos={0 0}, upload=19362]: Done uploading piece. err: ecclient: upload failed (node:12B7ox4ehqxJ2mwqeXj8C9N9GuSU5etNC23iT1pJnTgMLGBAGQK, address:104.36.82.46:4500): protocol: rpc: dial tcp 104.36.82.46:4500: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:02:58.277519126 (20h17m10.753457591s) [seg_pos={0 0}, upload=19362]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 29 13:02:58.506129815 (20h17m10.98206828s) [upload=19362]: Done uploading segments...
Jul 29 13:02:58.506160173 (20h17m10.982098648s) [upload=19362]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.231118863s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................XX............X...........X.................] duration:
1.832838038s
FAIL (2025-07-29 13:02:22 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.832868166s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X............X...............X........X...X..] duration:
19.961310196s
FAIL (2025-07-29 13:02:09 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 19.961336375s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................XX............X...........X................] duration:
1.863127041s
FAIL (2025-07-29 13:01:35 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.86314721s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X............X...............X........X...X.] duration:
23.952958923s
FAIL (2025-07-29 13:01:26 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 23.952992376s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X............X...............X........X...X] duration:
30.001979863s
FAIL (2025-07-29 13:00:58 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 30.002000612s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................XX............X...........X...............] duration:
1.962461217s
FAIL (2025-07-29 13:00:21 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.962492508s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X............X...............X........X...] duration:
16.421348048s
FAIL (2025-07-29 13:00:14 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 16.421371803s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................XX............X...........X..............] duration:
2.145425482s
FAIL (2025-07-29 13:00:06 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 2.145452381s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................X............X...............X........X..] duration:
21.8256661s
FAIL (2025-07-29 12:59:53 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 21.825689394s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................XX............X...........X.............] duration:
1.874839168s
FAIL (2025-07-29 12:59:10 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.874868124s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................X............X...............X........X.] duration:
22.963636002s
FAIL (2025-07-29 12:58:42 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 22.963674106s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................XX............X...........X............] duration:
1.85394006s
FAIL (2025-07-29 12:58:07 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.85396638s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X............X...............X........X] duration:
30.23814065s
FAIL (2025-07-29 12:58:03 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 30.23815613s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................XX............X...........X...........] duration:
2.103511688s
FAIL (2025-07-29 12:57:27 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 2.103540064s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X............X...............X........] duration:
25.91339623s
FAIL (2025-07-29 12:57:21 UTC)
orbiter warning: digest mismatch: after 13a6025f4ebc4e4ca1a450da62481863f6e4724e19f8e8a24360b045f91fe9db != before f97f5b687795fe75a9b51db523f8e24dc38ad835b996ef2b60d17eb54cfb5586
Duration: 25.913418351s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................XX............X...........X..........] duration:
1.827264751s
FAIL (2025-07-29 12:56:14 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.827301842s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X............X...............X.......] duration:
19.681931811s
FAIL (2025-07-29 12:56:00 UTC)
orbiter warning: digest mismatch: after 13a6025f4ebc4e4ca1a450da62481863f6e4724e19f8e8a24360b045f91fe9db != before f97f5b687795fe75a9b51db523f8e24dc38ad835b996ef2b60d17eb54cfb5586
Duration: 19.681953762s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X............X...............X......] duration:
18.525183092s
FAIL (2025-07-29 12:55:30 UTC)
orbiter warning: digest mismatch: after 13a6025f4ebc4e4ca1a450da62481863f6e4724e19f8e8a24360b045f91fe9db != before f97f5b687795fe75a9b51db523f8e24dc38ad835b996ef2b60d17eb54cfb5586
Duration: 18.52520827s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................XX............X...........X.........] duration:
1.878522867s
FAIL (2025-07-29 12:55:19 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.878556602s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X............X...............X.....] duration:
14.613552852s
FAIL (2025-07-29 12:54:59 UTC)
orbiter warning: digest mismatch: after 13a6025f4ebc4e4ca1a450da62481863f6e4724e19f8e8a24360b045f91fe9db != before f97f5b687795fe75a9b51db523f8e24dc38ad835b996ef2b60d17eb54cfb5586
Duration: 14.613581716s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................XX............X...........X........] duration:
1.925996471s
FAIL (2025-07-29 12:54:33 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.926021448s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X............X...............X....] duration:
17.007902601s
FAIL (2025-07-29 12:54:31 UTC)
orbiter warning: digest mismatch: after 13a6025f4ebc4e4ca1a450da62481863f6e4724e19f8e8a24360b045f91fe9db != before f97f5b687795fe75a9b51db523f8e24dc38ad835b996ef2b60d17eb54cfb5586
Duration: 17.007934111s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................XX............X...........X.......] duration:
1.977681372s
FAIL (2025-07-29 12:53:58 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.977713533s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X............X...............X...] duration:
16.15496672s
FAIL (2025-07-29 12:53:22 UTC)
orbiter warning: digest mismatch: after 13a6025f4ebc4e4ca1a450da62481863f6e4724e19f8e8a24360b045f91fe9db != before f97f5b687795fe75a9b51db523f8e24dc38ad835b996ef2b60d17eb54cfb5586
Duration: 16.154992491s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........................XX............X...........X......] duration:
2.044252155s
FAIL (2025-07-29 12:52:57 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 2.044283855s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X............X...............X..] duration:
24.671044766s
FAIL (2025-07-29 12:52:23 UTC)
orbiter warning: digest mismatch: after 13a6025f4ebc4e4ca1a450da62481863f6e4724e19f8e8a24360b045f91fe9db != before f97f5b687795fe75a9b51db523f8e24dc38ad835b996ef2b60d17eb54cfb5586
Duration: 24.671076317s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............................XX............X...........X.....] duration:
1.914511635s
FAIL (2025-07-29 12:52:02 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.914534409s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............................XX............X...........X....] duration:
1.877998894s
FAIL (2025-07-29 12:51:29 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.878037117s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................X............X...............X.] duration:
14.013190815s
FAIL (2025-07-29 12:51:14 UTC)
orbiter warning: digest mismatch: after 13a6025f4ebc4e4ca1a450da62481863f6e4724e19f8e8a24360b045f91fe9db != before f97f5b687795fe75a9b51db523f8e24dc38ad835b996ef2b60d17eb54cfb5586
Duration: 14.01321988s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............................XX............X...........X...] duration:
1.926405562s
FAIL (2025-07-29 12:50:59 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.926431401s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X............X...............X] duration:
16.189316692s
FAIL (2025-07-29 12:50:32 UTC)
orbiter warning: digest mismatch: after 13a6025f4ebc4e4ca1a450da62481863f6e4724e19f8e8a24360b045f91fe9db != before f97f5b687795fe75a9b51db523f8e24dc38ad835b996ef2b60d17eb54cfb5586
Duration: 16.189352041s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............................XX............X...........X..] duration:
1.853698231s
FAIL (2025-07-29 12:50:18 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.853725864s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X............X...............] duration:
12.236549075s
FAIL (2025-07-29 12:50:05 UTC)
orbiter warning: digest mismatch: after 5b6db1e6d2b7699828ffd44164221c8e65db4d21dc29280b07d32ebefacda028 != before 851514455c541efa3ebbc9167533f7f70a41053a763973b1111eb80a8025d0ba
Duration: 12.236679504s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................................XX............X...........X.] duration:
1.948419445s
FAIL (2025-07-29 12:49:56 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.948439752s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X............X..............] duration:
17.455974221s
FAIL (2025-07-29 12:49:15 UTC)
orbiter warning: digest mismatch: after 5b6db1e6d2b7699828ffd44164221c8e65db4d21dc29280b07d32ebefacda028 != before 851514455c541efa3ebbc9167533f7f70a41053a763973b1111eb80a8025d0ba
Duration: 17.455996944s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................................XX............X...........X] duration:
1.586370189s
FAIL (2025-07-29 12:49:02 UTC)
orbiter warning: unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.586396109s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................................XX............X...........] duration:
1.8794742s
FAIL (2025-07-29 12:48:35 UTC)
orbiter warning: uplink: object not found ("orbiter_us_0/1K")
Duration: 1.879504498s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X............X.............] duration:
17.361531992s
FAIL (2025-07-29 12:48:05 UTC)
orbiter warning: digest mismatch: after 5b6db1e6d2b7699828ffd44164221c8e65db4d21dc29280b07d32ebefacda028 != before 851514455c541efa3ebbc9167533f7f70a41053a763973b1111eb80a8025d0ba
Duration: 17.361564615s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................................XX............X..........] duration:
1.855003488s
FAIL (2025-07-29 12:47:58 UTC)
orbiter warning: uplink: object not found ("orbiter_us_0/1K")
Duration: 1.855024389s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X............X............] duration:
16.733201418s
FAIL (2025-07-29 12:47:41 UTC)
orbiter warning: digest mismatch: after 5b6db1e6d2b7699828ffd44164221c8e65db4d21dc29280b07d32ebefacda028 != before 851514455c541efa3ebbc9167533f7f70a41053a763973b1111eb80a8025d0ba
Duration: 16.733227498s
core
uplink
us-select-1
us1-placement-20
|