Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X........................................................X..] duration:
6.14742267s
FAIL (2025-08-22 00:01:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 13f1a714757aa7119d74cb540de177ecde0a02831fc99086bf6f814d8a0a876e != before 3547075f39b1777667159fdd9ca37ef6ae363538c4c8f4be8b14d991b66fce3b
======LOGS======
Aug 21 23:58:56.912883817 (318h32m51.343963948s) [upload=331406]: Starting upload
Aug 21 23:58:56.912937720 (318h32m51.344017851s) [upload=331406]: Done starting upload
Aug 21 23:58:56.913009557 (318h32m51.344089678s) [upload=331406]: Uploading segments...
Aug 21 23:58:56.913096523 (318h32m51.344176644s) [upload=331406]: Got next segment. Inline: false
Aug 21 23:58:56.913140257 (318h32m51.344220378s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:58:56.913145247 (318h32m51.344225378s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 23:58:57.366545832 (318h32m51.797625963s) [seg_pos={0 0}, upload=331406]: Begin upload segment...
Aug 21 23:58:57.366589977 (318h32m51.797670108s) [seg_pos={0 0}, upload=331406]: Done begin upload segment.
Aug 21 23:58:57.366722882 (318h32m51.797803013s) [noise=true , address=77.90.31.17:4774 , piece_id=S6SUMAC5BSX7PHSB5OXLOJ6ZBRQVQTUJXJ5HGJFJLUUQBZ6SUXZQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.366844995 (318h32m51.797925126s) [noise=true , address=45.91.116.4:4965 , piece_id=6LOOLEHEXKMODQCTNDJHTZJTPKGLZLERSXXRXPTF5MZMOYTSQR6A, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.367354119 (318h32m51.798434251s) [noise=true , address=104.36.82.36:4644 , piece_id=ECI2MP3S74QXX2A6FEA5EWLHOQ2KD2FSJUXEZ4SMW7CKIWX2ST6A, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.368165341 (318h32m51.799245462s) [noise=true , address=104.36.82.38:4691 , piece_id=MK2VTDGU4VNDODACSRQJUD7QSHBUSQQ4ED2NJKDIBB4WKZPCYLPQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.368409979 (318h32m51.7994901s) [noise=true , address=104.36.82.11:4135 , piece_id=I5RQULBDN3U3LUIAUTWYRQKQXPQWX224KDEXCW2Y2CQJYF2NQ4NQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.368738177 (318h32m51.799818308s) [noise=true , address=77.90.31.11:4560 , piece_id=7VBLXBZ56S2AOUF3QS6K5LBJURE3VUQSDARAISSPHGRT77S6MCZA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.369058250 (318h32m51.800138381s) [noise=true , address=104.36.82.54:4176 , piece_id=IXLYPABSEMZ5WX3Q7ILX5SFA3LXVFMI5LZDO5QVEBVRL76L4NHXQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.369373774 (318h32m51.800453905s) [noise=true , address=104.36.82.35:4613 , piece_id=SRWPMQN6QZ55GUQQLE7NZIKEUR5E77WZIMULMMKUNSCHIBGMODBA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.369703475 (318h32m51.800783606s) [noise=true , address=77.90.31.18:4820 , piece_id=IMPIA552N6SCVHKFOVMJ6AGMMEORX4EFLVMNODK4LAHU6PTWHBSQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.370293744 (318h32m51.801373875s) [noise=true , address=77.90.31.19:4845 , piece_id=MQ4TSAM2BZQNEGMSKUG2X33KZUPQLYRAALOYKYFOA6FQKVLBTJDQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.370787749 (318h32m51.80186787s) [noise=true , address=45.91.116.5:4305 , piece_id=MJO3CZNZPB6MCFP7HA257Z7XJGVQXZDQWMNX6SJJI7NOVDGWSWRQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.371216310 (318h32m51.802296441s) [noise=true , address=77.90.31.16:4753 , piece_id=FDU3PX3NMKMPF5NBJKAHP4PRPUAXWIE5IBGDRUHLV5GK3YIDVW3A, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.371635632 (318h32m51.802715763s) [noise=true , address=104.36.82.60:4363 , piece_id=XHPXNG4DRMZYPCQ6WTBZCRZ52YPHMBKTTHVNTZLJC66PP52LSEGA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.372266849 (318h32m51.80334698s) [noise=true , address=104.36.82.19:4418 , piece_id=IMGCO4UF4OXYIINSBMFPAFPIYH4YY7PENZYVLB26XXLW6EKCU3GQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.372680360 (318h32m51.803760492s) [noise=true , address=104.36.82.3:4786 , piece_id=HRAXFA337D3YKJVSA3UFYUIFH7QKPVMMZRNHHPAYT6ZTLM6DHQFA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.373075227 (318h32m51.804155358s) [noise=true , address=77.90.31.21:4882 , piece_id=CCRS4XJ2KGUIQGCLKH3IFIJ6VISOFVQA6Y2HYPSXED6VJWU6VUOQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.373556557 (318h32m51.804636688s) [noise=true , address=104.36.82.22:4517 , piece_id=Q3A7G2FI67W5JL7AR7SGEDPCYWTBUG4VABDIIBOGRPCSW3ZBS34Q, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.374845433 (318h32m51.805925564s) [noise=true , address=104.36.82.44:4870 , piece_id=6JICYQLRLBARFCHFM7XAHNDY7FRJJIDVOSV7PIWBI5QMJTDBMCQA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:58.901063715 (318h32m53.332143846s) [upload=331406]: Next returned nil segment
Aug 21 23:58:58.901109903 (318h32m53.332190035s) [upload=331406]: Waiting for error group managing segments...
Aug 21 23:58:59.292300116 (318h32m53.723380257s) [noise=true , address=104.36.82.35:4613 , piece_id=SRWPMQN6QZ55GUQQLE7NZIKEUR5E77WZIMULMMKUNSCHIBGMODBA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.297356570 (318h32m53.728436691s) [noise=true , address=104.36.82.54:4176 , piece_id=IXLYPABSEMZ5WX3Q7ILX5SFA3LXVFMI5LZDO5QVEBVRL76L4NHXQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.322223551 (318h32m53.753303682s) [noise=true , address=45.91.116.5:4305 , piece_id=MJO3CZNZPB6MCFP7HA257Z7XJGVQXZDQWMNX6SJJI7NOVDGWSWRQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.326507487 (318h32m53.757587619s) [noise=true , address=104.36.82.3:4786 , piece_id=HRAXFA337D3YKJVSA3UFYUIFH7QKPVMMZRNHHPAYT6ZTLM6DHQFA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.337102511 (318h32m53.768182642s) [noise=true , address=77.90.31.19:4845 , piece_id=MQ4TSAM2BZQNEGMSKUG2X33KZUPQLYRAALOYKYFOA6FQKVLBTJDQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.351021783 (318h32m53.782101904s) [noise=true , address=104.36.82.19:4418 , piece_id=IMGCO4UF4OXYIINSBMFPAFPIYH4YY7PENZYVLB26XXLW6EKCU3GQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.351722324 (318h32m53.782802455s) [noise=true , address=104.36.82.44:4870 , piece_id=6JICYQLRLBARFCHFM7XAHNDY7FRJJIDVOSV7PIWBI5QMJTDBMCQA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.356700810 (318h32m53.787780931s) [noise=true , address=104.36.82.11:4135 , piece_id=I5RQULBDN3U3LUIAUTWYRQKQXPQWX224KDEXCW2Y2CQJYF2NQ4NQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.363261754 (318h32m53.794341885s) [noise=true , address=77.90.31.16:4753 , piece_id=FDU3PX3NMKMPF5NBJKAHP4PRPUAXWIE5IBGDRUHLV5GK3YIDVW3A, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.377020579 (318h32m53.8081007s) [noise=true , address=104.36.82.38:4691 , piece_id=MK2VTDGU4VNDODACSRQJUD7QSHBUSQQ4ED2NJKDIBB4WKZPCYLPQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.408956636 (318h32m53.840036757s) [noise=true , address=77.90.31.17:4774 , piece_id=S6SUMAC5BSX7PHSB5OXLOJ6ZBRQVQTUJXJ5HGJFJLUUQBZ6SUXZQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.424634935 (318h32m53.855715066s) [noise=true , address=77.90.31.21:4882 , piece_id=CCRS4XJ2KGUIQGCLKH3IFIJ6VISOFVQA6Y2HYPSXED6VJWU6VUOQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.434055850 (318h32m53.865135981s) [noise=true , address=77.90.31.18:4820 , piece_id=IMPIA552N6SCVHKFOVMJ6AGMMEORX4EFLVMNODK4LAHU6PTWHBSQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.437831705 (318h32m53.868911836s) [noise=true , address=77.90.31.11:4560 , piece_id=7VBLXBZ56S2AOUF3QS6K5LBJURE3VUQSDARAISSPHGRT77S6MCZA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.437849640 (318h32m53.868929771s) [seg_pos={0 0}, upload=331406]: Segment reached optimal threshold of 14 pieces.
Aug 21 23:58:59.437948338 (318h32m53.869028469s) [noise=true , address=104.36.82.60:4363 , piece_id=XHPXNG4DRMZYPCQ6WTBZCRZ52YPHMBKTTHVNTZLJC66PP52LSEGA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1endke3P5J92vFytHPiVczH5VcuHDSXyvd4qK9kFNhkQh8MhL7): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.437987834 (318h32m53.869067965s) [noise=true , address=45.91.116.4:4965 , piece_id=6LOOLEHEXKMODQCTNDJHTZJTPKGLZLERSXXRXPTF5MZMOYTSQR6A, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKuthv2wScEvcdmCxmPiQGGZ5w4tJ5a6tbJdBKt1SJ4e9Cszi): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.438041197 (318h32m53.869121318s) [noise=true , address=104.36.82.36:4644 , piece_id=ECI2MP3S74QXX2A6FEA5EWLHOQ2KD2FSJUXEZ4SMW7CKIWX2ST6A, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oYHbb73ACitbfkkP5P6cmRyTt6kmaS1y49G4vbsvTvVDwByhT): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.438108415 (318h32m53.869188546s) [noise=true , address=104.36.82.22:4517 , piece_id=Q3A7G2FI67W5JL7AR7SGEDPCYWTBUG4VABDIIBOGRPCSW3ZBS34Q, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wSJWmZaz4FNEiar3UGW17tJc6XvaW4erEXbpAsWnE6FvuLRzT): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.438134945 (318h32m53.869215077s) [seg_pos={0 0}, upload=331406]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 23:58:59.438215720 (318h32m53.869295851s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 23:58:59.438221010 (318h32m53.869301141s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:59:00.470044418 (318h32m54.901124539s) [upload=331406]: Done uploading segments...
Aug 21 23:59:00.470063504 (318h32m54.901143635s) [upload=331406]: Upload finished. err: <nil>
Duration: 6.147453138s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X........................................................X.] duration:
6.296732198s
FAIL (2025-08-22 00:00:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 13f1a714757aa7119d74cb540de177ecde0a02831fc99086bf6f814d8a0a876e != before 3547075f39b1777667159fdd9ca37ef6ae363538c4c8f4be8b14d991b66fce3b
======LOGS======
Aug 21 23:58:56.912883817 (318h32m51.343963948s) [upload=331406]: Starting upload
Aug 21 23:58:56.912937720 (318h32m51.344017851s) [upload=331406]: Done starting upload
Aug 21 23:58:56.913009557 (318h32m51.344089678s) [upload=331406]: Uploading segments...
Aug 21 23:58:56.913096523 (318h32m51.344176644s) [upload=331406]: Got next segment. Inline: false
Aug 21 23:58:56.913140257 (318h32m51.344220378s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:58:56.913145247 (318h32m51.344225378s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 23:58:57.366545832 (318h32m51.797625963s) [seg_pos={0 0}, upload=331406]: Begin upload segment...
Aug 21 23:58:57.366589977 (318h32m51.797670108s) [seg_pos={0 0}, upload=331406]: Done begin upload segment.
Aug 21 23:58:57.366722882 (318h32m51.797803013s) [noise=true , address=77.90.31.17:4774 , piece_id=S6SUMAC5BSX7PHSB5OXLOJ6ZBRQVQTUJXJ5HGJFJLUUQBZ6SUXZQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.366844995 (318h32m51.797925126s) [noise=true , address=45.91.116.4:4965 , piece_id=6LOOLEHEXKMODQCTNDJHTZJTPKGLZLERSXXRXPTF5MZMOYTSQR6A, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.367354119 (318h32m51.798434251s) [noise=true , address=104.36.82.36:4644 , piece_id=ECI2MP3S74QXX2A6FEA5EWLHOQ2KD2FSJUXEZ4SMW7CKIWX2ST6A, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.368165341 (318h32m51.799245462s) [noise=true , address=104.36.82.38:4691 , piece_id=MK2VTDGU4VNDODACSRQJUD7QSHBUSQQ4ED2NJKDIBB4WKZPCYLPQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.368409979 (318h32m51.7994901s) [noise=true , address=104.36.82.11:4135 , piece_id=I5RQULBDN3U3LUIAUTWYRQKQXPQWX224KDEXCW2Y2CQJYF2NQ4NQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.368738177 (318h32m51.799818308s) [noise=true , address=77.90.31.11:4560 , piece_id=7VBLXBZ56S2AOUF3QS6K5LBJURE3VUQSDARAISSPHGRT77S6MCZA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.369058250 (318h32m51.800138381s) [noise=true , address=104.36.82.54:4176 , piece_id=IXLYPABSEMZ5WX3Q7ILX5SFA3LXVFMI5LZDO5QVEBVRL76L4NHXQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.369373774 (318h32m51.800453905s) [noise=true , address=104.36.82.35:4613 , piece_id=SRWPMQN6QZ55GUQQLE7NZIKEUR5E77WZIMULMMKUNSCHIBGMODBA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.369703475 (318h32m51.800783606s) [noise=true , address=77.90.31.18:4820 , piece_id=IMPIA552N6SCVHKFOVMJ6AGMMEORX4EFLVMNODK4LAHU6PTWHBSQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.370293744 (318h32m51.801373875s) [noise=true , address=77.90.31.19:4845 , piece_id=MQ4TSAM2BZQNEGMSKUG2X33KZUPQLYRAALOYKYFOA6FQKVLBTJDQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.370787749 (318h32m51.80186787s) [noise=true , address=45.91.116.5:4305 , piece_id=MJO3CZNZPB6MCFP7HA257Z7XJGVQXZDQWMNX6SJJI7NOVDGWSWRQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.371216310 (318h32m51.802296441s) [noise=true , address=77.90.31.16:4753 , piece_id=FDU3PX3NMKMPF5NBJKAHP4PRPUAXWIE5IBGDRUHLV5GK3YIDVW3A, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.371635632 (318h32m51.802715763s) [noise=true , address=104.36.82.60:4363 , piece_id=XHPXNG4DRMZYPCQ6WTBZCRZ52YPHMBKTTHVNTZLJC66PP52LSEGA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.372266849 (318h32m51.80334698s) [noise=true , address=104.36.82.19:4418 , piece_id=IMGCO4UF4OXYIINSBMFPAFPIYH4YY7PENZYVLB26XXLW6EKCU3GQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.372680360 (318h32m51.803760492s) [noise=true , address=104.36.82.3:4786 , piece_id=HRAXFA337D3YKJVSA3UFYUIFH7QKPVMMZRNHHPAYT6ZTLM6DHQFA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.373075227 (318h32m51.804155358s) [noise=true , address=77.90.31.21:4882 , piece_id=CCRS4XJ2KGUIQGCLKH3IFIJ6VISOFVQA6Y2HYPSXED6VJWU6VUOQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.373556557 (318h32m51.804636688s) [noise=true , address=104.36.82.22:4517 , piece_id=Q3A7G2FI67W5JL7AR7SGEDPCYWTBUG4VABDIIBOGRPCSW3ZBS34Q, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.374845433 (318h32m51.805925564s) [noise=true , address=104.36.82.44:4870 , piece_id=6JICYQLRLBARFCHFM7XAHNDY7FRJJIDVOSV7PIWBI5QMJTDBMCQA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:58.901063715 (318h32m53.332143846s) [upload=331406]: Next returned nil segment
Aug 21 23:58:58.901109903 (318h32m53.332190035s) [upload=331406]: Waiting for error group managing segments...
Aug 21 23:58:59.292300116 (318h32m53.723380257s) [noise=true , address=104.36.82.35:4613 , piece_id=SRWPMQN6QZ55GUQQLE7NZIKEUR5E77WZIMULMMKUNSCHIBGMODBA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.297356570 (318h32m53.728436691s) [noise=true , address=104.36.82.54:4176 , piece_id=IXLYPABSEMZ5WX3Q7ILX5SFA3LXVFMI5LZDO5QVEBVRL76L4NHXQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.322223551 (318h32m53.753303682s) [noise=true , address=45.91.116.5:4305 , piece_id=MJO3CZNZPB6MCFP7HA257Z7XJGVQXZDQWMNX6SJJI7NOVDGWSWRQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.326507487 (318h32m53.757587619s) [noise=true , address=104.36.82.3:4786 , piece_id=HRAXFA337D3YKJVSA3UFYUIFH7QKPVMMZRNHHPAYT6ZTLM6DHQFA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.337102511 (318h32m53.768182642s) [noise=true , address=77.90.31.19:4845 , piece_id=MQ4TSAM2BZQNEGMSKUG2X33KZUPQLYRAALOYKYFOA6FQKVLBTJDQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.351021783 (318h32m53.782101904s) [noise=true , address=104.36.82.19:4418 , piece_id=IMGCO4UF4OXYIINSBMFPAFPIYH4YY7PENZYVLB26XXLW6EKCU3GQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.351722324 (318h32m53.782802455s) [noise=true , address=104.36.82.44:4870 , piece_id=6JICYQLRLBARFCHFM7XAHNDY7FRJJIDVOSV7PIWBI5QMJTDBMCQA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.356700810 (318h32m53.787780931s) [noise=true , address=104.36.82.11:4135 , piece_id=I5RQULBDN3U3LUIAUTWYRQKQXPQWX224KDEXCW2Y2CQJYF2NQ4NQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.363261754 (318h32m53.794341885s) [noise=true , address=77.90.31.16:4753 , piece_id=FDU3PX3NMKMPF5NBJKAHP4PRPUAXWIE5IBGDRUHLV5GK3YIDVW3A, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.377020579 (318h32m53.8081007s) [noise=true , address=104.36.82.38:4691 , piece_id=MK2VTDGU4VNDODACSRQJUD7QSHBUSQQ4ED2NJKDIBB4WKZPCYLPQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.408956636 (318h32m53.840036757s) [noise=true , address=77.90.31.17:4774 , piece_id=S6SUMAC5BSX7PHSB5OXLOJ6ZBRQVQTUJXJ5HGJFJLUUQBZ6SUXZQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.424634935 (318h32m53.855715066s) [noise=true , address=77.90.31.21:4882 , piece_id=CCRS4XJ2KGUIQGCLKH3IFIJ6VISOFVQA6Y2HYPSXED6VJWU6VUOQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.434055850 (318h32m53.865135981s) [noise=true , address=77.90.31.18:4820 , piece_id=IMPIA552N6SCVHKFOVMJ6AGMMEORX4EFLVMNODK4LAHU6PTWHBSQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.437831705 (318h32m53.868911836s) [noise=true , address=77.90.31.11:4560 , piece_id=7VBLXBZ56S2AOUF3QS6K5LBJURE3VUQSDARAISSPHGRT77S6MCZA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.437849640 (318h32m53.868929771s) [seg_pos={0 0}, upload=331406]: Segment reached optimal threshold of 14 pieces.
Aug 21 23:58:59.437948338 (318h32m53.869028469s) [noise=true , address=104.36.82.60:4363 , piece_id=XHPXNG4DRMZYPCQ6WTBZCRZ52YPHMBKTTHVNTZLJC66PP52LSEGA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1endke3P5J92vFytHPiVczH5VcuHDSXyvd4qK9kFNhkQh8MhL7): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.437987834 (318h32m53.869067965s) [noise=true , address=45.91.116.4:4965 , piece_id=6LOOLEHEXKMODQCTNDJHTZJTPKGLZLERSXXRXPTF5MZMOYTSQR6A, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKuthv2wScEvcdmCxmPiQGGZ5w4tJ5a6tbJdBKt1SJ4e9Cszi): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.438041197 (318h32m53.869121318s) [noise=true , address=104.36.82.36:4644 , piece_id=ECI2MP3S74QXX2A6FEA5EWLHOQ2KD2FSJUXEZ4SMW7CKIWX2ST6A, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oYHbb73ACitbfkkP5P6cmRyTt6kmaS1y49G4vbsvTvVDwByhT): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.438108415 (318h32m53.869188546s) [noise=true , address=104.36.82.22:4517 , piece_id=Q3A7G2FI67W5JL7AR7SGEDPCYWTBUG4VABDIIBOGRPCSW3ZBS34Q, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wSJWmZaz4FNEiar3UGW17tJc6XvaW4erEXbpAsWnE6FvuLRzT): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.438134945 (318h32m53.869215077s) [seg_pos={0 0}, upload=331406]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 23:58:59.438215720 (318h32m53.869295851s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 23:58:59.438221010 (318h32m53.869301141s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:59:00.470044418 (318h32m54.901124539s) [upload=331406]: Done uploading segments...
Aug 21 23:59:00.470063504 (318h32m54.901143635s) [upload=331406]: Upload finished. err: <nil>
Duration: 6.296764178s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X.X......X............X....................X......] duration:
1.963070271s
FAIL (2025-08-22 00:00:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 23:56:40.195048536 (318h30m34.626128667s) [upload=331365]: Starting upload Aug 21 23:56:40.195099043 (318h30m34.626179164s) [upload=331365]: Done starting upload Aug 21 23:56:40.195208652 (318h30m34.626288783s) [upload=331365]: Uploading segments... Aug 21 23:56:40.195359691 (318h30m34.626439812s) [upload=331365]: Got next segment. Inline: true Aug 21 23:56:40.195367716 (318h30m34.626447867s) [upload=331365]: Waiting for error group managing segments... Aug 21 23:56:40.195466305 (318h30m34.626546436s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:56:40.195475132 (318h30m34.626555263s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:56:40.195479491 (318h30m34.626559622s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:56:40.480799300 (318h30m34.911879431s) [upload=331365]: Done uploading segments... Aug 21 23:56:40.480837173 (318h30m34.911917304s) [upload=331365]: Upload finished. err: <nil>
Duration: 1.963103686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X.X......X............X....................X.....] duration:
1.912711868s
FAIL (2025-08-21 23:59:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 23:56:40.195048536 (318h30m34.626128667s) [upload=331365]: Starting upload Aug 21 23:56:40.195099043 (318h30m34.626179164s) [upload=331365]: Done starting upload Aug 21 23:56:40.195208652 (318h30m34.626288783s) [upload=331365]: Uploading segments... Aug 21 23:56:40.195359691 (318h30m34.626439812s) [upload=331365]: Got next segment. Inline: true Aug 21 23:56:40.195367716 (318h30m34.626447867s) [upload=331365]: Waiting for error group managing segments... Aug 21 23:56:40.195466305 (318h30m34.626546436s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:56:40.195475132 (318h30m34.626555263s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:56:40.195479491 (318h30m34.626559622s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:56:40.480799300 (318h30m34.911879431s) [upload=331365]: Done uploading segments... Aug 21 23:56:40.480837173 (318h30m34.911917304s) [upload=331365]: Upload finished. err: <nil>
Duration: 1.91272934s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X.X......X............X....................X....] duration:
1.830206339s
FAIL (2025-08-21 23:59:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 23:56:40.195048536 (318h30m34.626128667s) [upload=331365]: Starting upload Aug 21 23:56:40.195099043 (318h30m34.626179164s) [upload=331365]: Done starting upload Aug 21 23:56:40.195208652 (318h30m34.626288783s) [upload=331365]: Uploading segments... Aug 21 23:56:40.195359691 (318h30m34.626439812s) [upload=331365]: Got next segment. Inline: true Aug 21 23:56:40.195367716 (318h30m34.626447867s) [upload=331365]: Waiting for error group managing segments... Aug 21 23:56:40.195466305 (318h30m34.626546436s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:56:40.195475132 (318h30m34.626555263s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:56:40.195479491 (318h30m34.626559622s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:56:40.480799300 (318h30m34.911879431s) [upload=331365]: Done uploading segments... Aug 21 23:56:40.480837173 (318h30m34.911917304s) [upload=331365]: Upload finished. err: <nil>
Duration: 1.830258459s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X........................................................X] duration:
6.486978724s
FAIL (2025-08-21 23:59:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 13f1a714757aa7119d74cb540de177ecde0a02831fc99086bf6f814d8a0a876e != before 3547075f39b1777667159fdd9ca37ef6ae363538c4c8f4be8b14d991b66fce3b
======LOGS======
Aug 21 23:58:56.912883817 (318h32m51.343963948s) [upload=331406]: Starting upload
Aug 21 23:58:56.912937720 (318h32m51.344017851s) [upload=331406]: Done starting upload
Aug 21 23:58:56.913009557 (318h32m51.344089678s) [upload=331406]: Uploading segments...
Aug 21 23:58:56.913096523 (318h32m51.344176644s) [upload=331406]: Got next segment. Inline: false
Aug 21 23:58:56.913140257 (318h32m51.344220378s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 23:58:56.913145247 (318h32m51.344225378s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 23:58:57.366545832 (318h32m51.797625963s) [seg_pos={0 0}, upload=331406]: Begin upload segment...
Aug 21 23:58:57.366589977 (318h32m51.797670108s) [seg_pos={0 0}, upload=331406]: Done begin upload segment.
Aug 21 23:58:57.366722882 (318h32m51.797803013s) [noise=true , address=77.90.31.17:4774 , piece_id=S6SUMAC5BSX7PHSB5OXLOJ6ZBRQVQTUJXJ5HGJFJLUUQBZ6SUXZQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.366844995 (318h32m51.797925126s) [noise=true , address=45.91.116.4:4965 , piece_id=6LOOLEHEXKMODQCTNDJHTZJTPKGLZLERSXXRXPTF5MZMOYTSQR6A, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.367354119 (318h32m51.798434251s) [noise=true , address=104.36.82.36:4644 , piece_id=ECI2MP3S74QXX2A6FEA5EWLHOQ2KD2FSJUXEZ4SMW7CKIWX2ST6A, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.368165341 (318h32m51.799245462s) [noise=true , address=104.36.82.38:4691 , piece_id=MK2VTDGU4VNDODACSRQJUD7QSHBUSQQ4ED2NJKDIBB4WKZPCYLPQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.368409979 (318h32m51.7994901s) [noise=true , address=104.36.82.11:4135 , piece_id=I5RQULBDN3U3LUIAUTWYRQKQXPQWX224KDEXCW2Y2CQJYF2NQ4NQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.368738177 (318h32m51.799818308s) [noise=true , address=77.90.31.11:4560 , piece_id=7VBLXBZ56S2AOUF3QS6K5LBJURE3VUQSDARAISSPHGRT77S6MCZA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.369058250 (318h32m51.800138381s) [noise=true , address=104.36.82.54:4176 , piece_id=IXLYPABSEMZ5WX3Q7ILX5SFA3LXVFMI5LZDO5QVEBVRL76L4NHXQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.369373774 (318h32m51.800453905s) [noise=true , address=104.36.82.35:4613 , piece_id=SRWPMQN6QZ55GUQQLE7NZIKEUR5E77WZIMULMMKUNSCHIBGMODBA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.369703475 (318h32m51.800783606s) [noise=true , address=77.90.31.18:4820 , piece_id=IMPIA552N6SCVHKFOVMJ6AGMMEORX4EFLVMNODK4LAHU6PTWHBSQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.370293744 (318h32m51.801373875s) [noise=true , address=77.90.31.19:4845 , piece_id=MQ4TSAM2BZQNEGMSKUG2X33KZUPQLYRAALOYKYFOA6FQKVLBTJDQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.370787749 (318h32m51.80186787s) [noise=true , address=45.91.116.5:4305 , piece_id=MJO3CZNZPB6MCFP7HA257Z7XJGVQXZDQWMNX6SJJI7NOVDGWSWRQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.371216310 (318h32m51.802296441s) [noise=true , address=77.90.31.16:4753 , piece_id=FDU3PX3NMKMPF5NBJKAHP4PRPUAXWIE5IBGDRUHLV5GK3YIDVW3A, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.371635632 (318h32m51.802715763s) [noise=true , address=104.36.82.60:4363 , piece_id=XHPXNG4DRMZYPCQ6WTBZCRZ52YPHMBKTTHVNTZLJC66PP52LSEGA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.372266849 (318h32m51.80334698s) [noise=true , address=104.36.82.19:4418 , piece_id=IMGCO4UF4OXYIINSBMFPAFPIYH4YY7PENZYVLB26XXLW6EKCU3GQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.372680360 (318h32m51.803760492s) [noise=true , address=104.36.82.3:4786 , piece_id=HRAXFA337D3YKJVSA3UFYUIFH7QKPVMMZRNHHPAYT6ZTLM6DHQFA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.373075227 (318h32m51.804155358s) [noise=true , address=77.90.31.21:4882 , piece_id=CCRS4XJ2KGUIQGCLKH3IFIJ6VISOFVQA6Y2HYPSXED6VJWU6VUOQ, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.373556557 (318h32m51.804636688s) [noise=true , address=104.36.82.22:4517 , piece_id=Q3A7G2FI67W5JL7AR7SGEDPCYWTBUG4VABDIIBOGRPCSW3ZBS34Q, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:57.374845433 (318h32m51.805925564s) [noise=true , address=104.36.82.44:4870 , piece_id=6JICYQLRLBARFCHFM7XAHNDY7FRJJIDVOSV7PIWBI5QMJTDBMCQA, seg_pos={0 0}, upload=331406]: Uploading piece...
Aug 21 23:58:58.901063715 (318h32m53.332143846s) [upload=331406]: Next returned nil segment
Aug 21 23:58:58.901109903 (318h32m53.332190035s) [upload=331406]: Waiting for error group managing segments...
Aug 21 23:58:59.292300116 (318h32m53.723380257s) [noise=true , address=104.36.82.35:4613 , piece_id=SRWPMQN6QZ55GUQQLE7NZIKEUR5E77WZIMULMMKUNSCHIBGMODBA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.297356570 (318h32m53.728436691s) [noise=true , address=104.36.82.54:4176 , piece_id=IXLYPABSEMZ5WX3Q7ILX5SFA3LXVFMI5LZDO5QVEBVRL76L4NHXQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.322223551 (318h32m53.753303682s) [noise=true , address=45.91.116.5:4305 , piece_id=MJO3CZNZPB6MCFP7HA257Z7XJGVQXZDQWMNX6SJJI7NOVDGWSWRQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.326507487 (318h32m53.757587619s) [noise=true , address=104.36.82.3:4786 , piece_id=HRAXFA337D3YKJVSA3UFYUIFH7QKPVMMZRNHHPAYT6ZTLM6DHQFA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.337102511 (318h32m53.768182642s) [noise=true , address=77.90.31.19:4845 , piece_id=MQ4TSAM2BZQNEGMSKUG2X33KZUPQLYRAALOYKYFOA6FQKVLBTJDQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.351021783 (318h32m53.782101904s) [noise=true , address=104.36.82.19:4418 , piece_id=IMGCO4UF4OXYIINSBMFPAFPIYH4YY7PENZYVLB26XXLW6EKCU3GQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.351722324 (318h32m53.782802455s) [noise=true , address=104.36.82.44:4870 , piece_id=6JICYQLRLBARFCHFM7XAHNDY7FRJJIDVOSV7PIWBI5QMJTDBMCQA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.356700810 (318h32m53.787780931s) [noise=true , address=104.36.82.11:4135 , piece_id=I5RQULBDN3U3LUIAUTWYRQKQXPQWX224KDEXCW2Y2CQJYF2NQ4NQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.363261754 (318h32m53.794341885s) [noise=true , address=77.90.31.16:4753 , piece_id=FDU3PX3NMKMPF5NBJKAHP4PRPUAXWIE5IBGDRUHLV5GK3YIDVW3A, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.377020579 (318h32m53.8081007s) [noise=true , address=104.36.82.38:4691 , piece_id=MK2VTDGU4VNDODACSRQJUD7QSHBUSQQ4ED2NJKDIBB4WKZPCYLPQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.408956636 (318h32m53.840036757s) [noise=true , address=77.90.31.17:4774 , piece_id=S6SUMAC5BSX7PHSB5OXLOJ6ZBRQVQTUJXJ5HGJFJLUUQBZ6SUXZQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.424634935 (318h32m53.855715066s) [noise=true , address=77.90.31.21:4882 , piece_id=CCRS4XJ2KGUIQGCLKH3IFIJ6VISOFVQA6Y2HYPSXED6VJWU6VUOQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.434055850 (318h32m53.865135981s) [noise=true , address=77.90.31.18:4820 , piece_id=IMPIA552N6SCVHKFOVMJ6AGMMEORX4EFLVMNODK4LAHU6PTWHBSQ, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.437831705 (318h32m53.868911836s) [noise=true , address=77.90.31.11:4560 , piece_id=7VBLXBZ56S2AOUF3QS6K5LBJURE3VUQSDARAISSPHGRT77S6MCZA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: <nil>
Aug 21 23:58:59.437849640 (318h32m53.868929771s) [seg_pos={0 0}, upload=331406]: Segment reached optimal threshold of 14 pieces.
Aug 21 23:58:59.437948338 (318h32m53.869028469s) [noise=true , address=104.36.82.60:4363 , piece_id=XHPXNG4DRMZYPCQ6WTBZCRZ52YPHMBKTTHVNTZLJC66PP52LSEGA, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1endke3P5J92vFytHPiVczH5VcuHDSXyvd4qK9kFNhkQh8MhL7): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.437987834 (318h32m53.869067965s) [noise=true , address=45.91.116.4:4965 , piece_id=6LOOLEHEXKMODQCTNDJHTZJTPKGLZLERSXXRXPTF5MZMOYTSQR6A, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKuthv2wScEvcdmCxmPiQGGZ5w4tJ5a6tbJdBKt1SJ4e9Cszi): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.438041197 (318h32m53.869121318s) [noise=true , address=104.36.82.36:4644 , piece_id=ECI2MP3S74QXX2A6FEA5EWLHOQ2KD2FSJUXEZ4SMW7CKIWX2ST6A, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oYHbb73ACitbfkkP5P6cmRyTt6kmaS1y49G4vbsvTvVDwByhT): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.438108415 (318h32m53.869188546s) [noise=true , address=104.36.82.22:4517 , piece_id=Q3A7G2FI67W5JL7AR7SGEDPCYWTBUG4VABDIIBOGRPCSW3ZBS34Q, seg_pos={0 0}, upload=331406]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wSJWmZaz4FNEiar3UGW17tJc6XvaW4erEXbpAsWnE6FvuLRzT): protocol: expected piece hash; context canceled; EOF
Aug 21 23:58:59.438134945 (318h32m53.869215077s) [seg_pos={0 0}, upload=331406]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 23:58:59.438215720 (318h32m53.869295851s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 23:58:59.438221010 (318h32m53.869301141s) [upload=331406]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 23:59:00.470044418 (318h32m54.901124539s) [upload=331406]: Done uploading segments...
Aug 21 23:59:00.470063504 (318h32m54.901143635s) [upload=331406]: Upload finished. err: <nil>
Duration: 6.487003751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X.X......X............X....................X...] duration:
1.902386012s
FAIL (2025-08-21 23:58:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 23:56:40.195048536 (318h30m34.626128667s) [upload=331365]: Starting upload Aug 21 23:56:40.195099043 (318h30m34.626179164s) [upload=331365]: Done starting upload Aug 21 23:56:40.195208652 (318h30m34.626288783s) [upload=331365]: Uploading segments... Aug 21 23:56:40.195359691 (318h30m34.626439812s) [upload=331365]: Got next segment. Inline: true Aug 21 23:56:40.195367716 (318h30m34.626447867s) [upload=331365]: Waiting for error group managing segments... Aug 21 23:56:40.195466305 (318h30m34.626546436s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:56:40.195475132 (318h30m34.626555263s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:56:40.195479491 (318h30m34.626559622s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:56:40.480799300 (318h30m34.911879431s) [upload=331365]: Done uploading segments... Aug 21 23:56:40.480837173 (318h30m34.911917304s) [upload=331365]: Upload finished. err: <nil>
Duration: 1.902410157s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X.............X.X......X............X....................X..] duration:
1.854709966s
FAIL (2025-08-21 23:58:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 23:56:40.195048536 (318h30m34.626128667s) [upload=331365]: Starting upload Aug 21 23:56:40.195099043 (318h30m34.626179164s) [upload=331365]: Done starting upload Aug 21 23:56:40.195208652 (318h30m34.626288783s) [upload=331365]: Uploading segments... Aug 21 23:56:40.195359691 (318h30m34.626439812s) [upload=331365]: Got next segment. Inline: true Aug 21 23:56:40.195367716 (318h30m34.626447867s) [upload=331365]: Waiting for error group managing segments... Aug 21 23:56:40.195466305 (318h30m34.626546436s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:56:40.195475132 (318h30m34.626555263s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:56:40.195479491 (318h30m34.626559622s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:56:40.480799300 (318h30m34.911879431s) [upload=331365]: Done uploading segments... Aug 21 23:56:40.480837173 (318h30m34.911917304s) [upload=331365]: Upload finished. err: <nil>
Duration: 1.854731207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.994975507s
FAIL (2025-08-21 23:57:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.994998692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [XX.............X.X......X............X....................X.] duration:
1.973884544s
FAIL (2025-08-21 23:57:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 23:56:40.195048536 (318h30m34.626128667s) [upload=331365]: Starting upload Aug 21 23:56:40.195099043 (318h30m34.626179164s) [upload=331365]: Done starting upload Aug 21 23:56:40.195208652 (318h30m34.626288783s) [upload=331365]: Uploading segments... Aug 21 23:56:40.195359691 (318h30m34.626439812s) [upload=331365]: Got next segment. Inline: true Aug 21 23:56:40.195367716 (318h30m34.626447867s) [upload=331365]: Waiting for error group managing segments... Aug 21 23:56:40.195466305 (318h30m34.626546436s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:56:40.195475132 (318h30m34.626555263s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:56:40.195479491 (318h30m34.626559622s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:56:40.480799300 (318h30m34.911879431s) [upload=331365]: Done uploading segments... Aug 21 23:56:40.480837173 (318h30m34.911917304s) [upload=331365]: Upload finished. err: <nil>
Duration: 1.973910194s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.939896793s
FAIL (2025-08-21 23:57:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.939920277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.XX.............X.X......X............X....................X] duration:
1.393753734s
FAIL (2025-08-21 23:56:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 23:56:40.195048536 (318h30m34.626128667s) [upload=331365]: Starting upload Aug 21 23:56:40.195099043 (318h30m34.626179164s) [upload=331365]: Done starting upload Aug 21 23:56:40.195208652 (318h30m34.626288783s) [upload=331365]: Uploading segments... Aug 21 23:56:40.195359691 (318h30m34.626439812s) [upload=331365]: Got next segment. Inline: true Aug 21 23:56:40.195367716 (318h30m34.626447867s) [upload=331365]: Waiting for error group managing segments... Aug 21 23:56:40.195466305 (318h30m34.626546436s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:56:40.195475132 (318h30m34.626555263s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:56:40.195479491 (318h30m34.626559622s) [upload=331365]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:56:40.480799300 (318h30m34.911879431s) [upload=331365]: Done uploading segments... Aug 21 23:56:40.480837173 (318h30m34.911917304s) [upload=331365]: Upload finished. err: <nil>
Duration: 1.39378318s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.976475277s
FAIL (2025-08-21 23:56:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.976496889s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.919099938s
FAIL (2025-08-21 23:55:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.919122601s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..XX.............X.X......X............X....................] duration:
2.039162156s
FAIL (2025-08-21 23:55:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.039204167s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.036731624s
FAIL (2025-08-21 23:54:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.036753155s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...XX.............X.X......X............X...................] duration:
2.084694162s
FAIL (2025-08-21 23:54:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.084851373s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.920781224s
FAIL (2025-08-21 23:53:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.920810319s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....XX.............X.X......X............X..................] duration:
1.973163778s
FAIL (2025-08-21 23:53:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 1.973214895s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.11598089s
FAIL (2025-08-21 23:53:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.115999034s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....XX.............X.X......X............X.................] duration:
2.082494716s
FAIL (2025-08-21 23:52:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.082525776s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......XX.............X.X......X............X................] duration:
1.824863407s
FAIL (2025-08-21 23:51:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 1.824896361s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.874841471s
FAIL (2025-08-21 23:51:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.874866699s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......XX.............X.X......X............X...............] duration:
2.096839597s
FAIL (2025-08-21 23:51:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.096871026s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.991669902s
FAIL (2025-08-21 23:50:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.991773039s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........XX.............X.X......X............X..............] duration:
1.844470302s
FAIL (2025-08-21 23:50:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 1.844494267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...........X...............................................] duration:
5.981397468s
FAIL (2025-08-21 23:49:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.981423007s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X........XX.............X.X......X............X.............] duration:
2.266480797s
FAIL (2025-08-21 23:49:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.266506267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X...........X..............................................] duration:
5.908548516s
FAIL (2025-08-21 23:48:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.908573364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X........XX.............X.X......X............X............] duration:
1.86865223s
FAIL (2025-08-21 23:48:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 1.86868339s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X........XX.............X.X......X............X...........] duration:
1.905806979s
FAIL (2025-08-21 23:48:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 1.905849901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...........X.............................................] duration:
5.90411161s
FAIL (2025-08-21 23:47:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.904161105s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X........XX.............X.X......X............X..........] duration:
1.995532435s
FAIL (2025-08-21 23:47:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 1.995568734s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [X...X........XX.............X.X......X............X.........] duration:
2.060542665s
FAIL (2025-08-21 23:46:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.060573825s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X...........X............................................] duration:
6.103136864s
FAIL (2025-08-21 23:46:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.10316168s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [.X...X........XX.............X.X......X............X........] duration:
2.248704473s
FAIL (2025-08-21 23:46:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.248731656s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...........X...........................................] duration:
5.817180986s
FAIL (2025-08-21 23:46:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.817213116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X...........X..........................................] duration:
6.26719551s
FAIL (2025-08-21 23:45:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.267213414s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [..X...X........XX.............X.X......X............X.......] duration:
1.855257808s
FAIL (2025-08-21 23:45:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 1.855283858s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [...X...X........XX.............X.X......X............X......] duration:
2.278129507s
FAIL (2025-08-21 23:45:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.278158212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X...........X.........................................] duration:
6.128075178s
FAIL (2025-08-21 23:44:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.128092191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.769352804s
FAIL (2025-08-21 23:44:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.769380047s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [....X...X........XX.............X.X......X............X.....] duration:
2.007869545s
FAIL (2025-08-21 23:44:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.007896556s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
6.125002284s
FAIL (2025-08-21 23:44:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.125027992s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X...........X........................................] duration:
5.985149777s
FAIL (2025-08-21 23:43:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.985178671s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
5.836355195s
FAIL (2025-08-21 23:43:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.836376757s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [.....X...X........XX.............X.X......X............X....] duration:
1.845480853s
FAIL (2025-08-21 23:43:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 1.845506802s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [......X...X........XX.............X.X......X............X...] duration:
2.142437835s
FAIL (2025-08-21 23:42:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 87129963ee18e5484901f879c007a2686ac49f04e963b08dbd3f68f163c2e642 != before 22e169f00ea97cb4ac3777b481aadca8984772682ca00b97c6a620a29a0cb99e ======LOGS====== Aug 21 23:40:43.581150952 (318h14m38.012231073s) [upload=331096]: Starting upload Aug 21 23:40:43.581240302 (318h14m38.012320433s) [upload=331096]: Done starting upload Aug 21 23:40:43.581310708 (318h14m38.012390839s) [upload=331096]: Uploading segments... Aug 21 23:40:43.581407873 (318h14m38.012488004s) [upload=331096]: Got next segment. Inline: true Aug 21 23:40:43.581413203 (318h14m38.012493334s) [upload=331096]: Waiting for error group managing segments... Aug 21 23:40:43.581466966 (318h14m38.012547097s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:40:43.581473529 (318h14m38.01255366s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 23:40:43.581476304 (318h14m38.012556425s) [upload=331096]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 23:40:44.102174001 (318h14m38.533254132s) [upload=331096]: Done uploading segments... Aug 21 23:40:44.102190403 (318h14m38.533270534s) [upload=331096]: Upload finished. err: <nil>
Duration: 2.14245712s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
6.175211577s
FAIL (2025-08-21 23:42:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.175226475s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X...........X.......................................] duration:
6.125655707s
FAIL (2025-08-21 23:42:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 23:11:30.202122178 (317h45m24.633202309s) [upload=330588]: Starting upload Aug 21 23:11:30.202182443 (317h45m24.633262574s) [upload=330588]: Done starting upload Aug 21 23:11:30.202313304 (317h45m24.633393435s) [upload=330588]: Uploading segments... Aug 21 23:11:30.207769824 (317h45m24.638849955s) [upload=330588]: Got next segment. Inline: false Aug 21 23:11:30.207842683 (317h45m24.638922814s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 23:11:30.207858754 (317h45m24.638938885s) [upload=330588]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 23:11:30.421157246 (317h45m24.852237377s) [upload=330588]: Next segment err: metaclient: Too Many Requests Aug 21 23:11:30.421175901 (317h45m24.852256022s) [upload=330588]: Done uploading segments... Aug 21 23:11:30.421188716 (317h45m24.852268857s) [upload=330588]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.125674794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|