Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.................X...............X.X.....X..............] duration:
5.716935303s
FAIL (2025-08-20 19:43:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.716963748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.........X.....................X..............] duration:
1.945404394s
FAIL (2025-08-20 19:43:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.945430596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.........X.....................X.............] duration:
1.837269894s
FAIL (2025-08-20 19:42:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.837301215s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X.................X...............X.X.....X.............] duration:
5.639542554s
FAIL (2025-08-20 19:42:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.639574674s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X.................X...............X.X.....X............] duration:
5.761578036s
FAIL (2025-08-20 19:41:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.761603454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.........X.....................X............] duration:
1.961408515s
FAIL (2025-08-20 19:41:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.961435345s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X.................X...............X.X.....X...........] duration:
5.862022116s
FAIL (2025-08-20 19:40:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.86203963s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.........X.....................X...........] duration:
1.888129196s
FAIL (2025-08-20 19:40:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.888152412s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X.................X...............X.X.....X..........] duration:
5.79161342s
FAIL (2025-08-20 19:40:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.791637785s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.........X.....................X..........] duration:
1.854821926s
FAIL (2025-08-20 19:40:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854848538s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.........X.....................X.........] duration:
1.872246726s
FAIL (2025-08-20 19:39:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.872293558s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X.................X...............X.X.....X.........] duration:
6.020278923s
FAIL (2025-08-20 19:39:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 6.020321734s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.........X.....................X........] duration:
1.890685386s
FAIL (2025-08-20 19:39:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.890714091s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X.................X...............X.X.....X........] duration:
5.853571877s
FAIL (2025-08-20 19:39:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.853597126s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.........X.....................X.......] duration:
1.893906469s
FAIL (2025-08-20 19:38:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.893937117s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........X.................X...............X.X.....X.......] duration:
5.982396477s
FAIL (2025-08-20 19:37:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.9824242s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.........X.....................X......] duration:
1.936583757s
FAIL (2025-08-20 19:37:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.936602293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X.................X...............X.X.....X......] duration:
5.844303898s
FAIL (2025-08-20 19:36:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.84433194s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X.................X...............X.X.....X.....] duration:
6.008197313s
FAIL (2025-08-20 19:36:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 6.008278409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.........X.....................X.....] duration:
2.20516346s
FAIL (2025-08-20 19:35:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.20519513s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X.................X...............X.X.....X....] duration:
5.79727888s
FAIL (2025-08-20 19:35:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.797303758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.........X.....................X....] duration:
2.088432981s
FAIL (2025-08-20 19:35:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.088461477s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X.................X...............X.X.....X...] duration:
6.66225049s
FAIL (2025-08-20 19:34:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 6.662265157s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.........X.....................X...] duration:
2.23043819s
FAIL (2025-08-20 19:34:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.23046436s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X.................X...............X.X.....X..] duration:
6.176945646s
FAIL (2025-08-20 19:34:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 6.176971827s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.........X.....................X..] duration:
1.868448522s
FAIL (2025-08-20 19:33:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.868482636s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X.................X...............X.X.....X.] duration:
5.792414274s
FAIL (2025-08-20 19:33:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.79243836s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.........X.....................X.] duration:
2.050007357s
FAIL (2025-08-20 19:32:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.050033497s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X.................X...............X.X.....X] duration:
5.869389786s
FAIL (2025-08-20 19:32:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.869415947s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.........X.....................X] duration:
859.235476ms
FAIL (2025-08-20 19:32:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.255985ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X.................X...............X.X.....] duration:
7.11979919s
FAIL (2025-08-20 19:32:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:29:09.986586438 (290h3m4.417666569s) [upload=301626]: Starting upload
Aug 20 19:29:09.986635582 (290h3m4.417715713s) [upload=301626]: Done starting upload
Aug 20 19:29:09.986737037 (290h3m4.417817258s) [upload=301626]: Uploading segments...
Aug 20 19:29:09.986826828 (290h3m4.417907049s) [upload=301626]: Got next segment. Inline: false
Aug 20 19:29:09.986899076 (290h3m4.417979287s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:29:09.986909516 (290h3m4.417989678s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:29:10.449938903 (290h3m4.881019034s) [seg_pos={0 0}, upload=301626]: Begin upload segment...
Aug 20 19:29:10.449989208 (290h3m4.881069339s) [seg_pos={0 0}, upload=301626]: Done begin upload segment.
Aug 20 19:29:10.450002224 (290h3m4.881082355s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450019686 (290h3m4.881099817s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450359888 (290h3m4.881440019s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450371700 (290h3m4.881451831s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450714256 (290h3m4.881794387s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451038567 (290h3m4.882118698s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451303313 (290h3m4.882383434s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451733746 (290h3m4.882813878s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452014844 (290h3m4.883094965s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452341589 (290h3m4.88342172s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452609111 (290h3m4.883689243s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452806609 (290h3m4.88388674s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453011461 (290h3m4.884091592s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453237573 (290h3m4.884317704s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453520174 (290h3m4.884600296s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453755975 (290h3m4.884836106s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454264959 (290h3m4.88534509s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454670986 (290h3m4.885751118s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:11.953504725 (290h3m6.384584846s) [upload=301626]: Next returned nil segment
Aug 20 19:29:11.953557877 (290h3m6.384638008s) [upload=301626]: Waiting for error group managing segments...
Aug 20 19:29:12.384942646 (290h3m6.816022767s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.415329336 (290h3m6.846409467s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.424369483 (290h3m6.855449604s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.443355440 (290h3m6.874435561s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.452824077 (290h3m6.883904208s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.469484154 (290h3m6.900564285s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.477834391 (290h3m6.908914522s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.483518136 (290h3m6.914598267s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.508025247 (290h3m6.939105378s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.510723420 (290h3m6.941803551s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.526588837 (290h3m6.957668968s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.538613484 (290h3m6.969693615s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.540997856 (290h3m6.972077998s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551373369 (290h3m6.9824535s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551407153 (290h3m6.982487284s) [seg_pos={0 0}, upload=301626]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:29:12.551557290 (290h3m6.982637421s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551639297 (290h3m6.982719428s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXruuVjtSTQ6AjVR4xV6KRWQbpw6X7CgH5aBU71LX53eNghc1): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551654486 (290h3m6.982734617s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZ945gjHWqLgS2Zccf7NTZCY7RLdnPLUebH2ZPEytMuyjmvvF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551707728 (290h3m6.982787859s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TxoPpye17ET1GR52xy2EmkUdq83x4T9TsfuwrKr8cYXf3HLYt): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551758375 (290h3m6.982838506s) [seg_pos={0 0}, upload=301626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:29:12.551842727 (290h3m6.982922858s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:29:12.551848297 (290h3m6.982928428s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:29:12.981791737 (290h3m7.412871888s) [upload=301626]: Done uploading segments...
Aug 20 19:29:12.981827076 (290h3m7.412907207s) [upload=301626]: Upload finished. err: <nil>
Duration: 7.119822535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................X.................X...............X.X....] duration:
6.000407686s
FAIL (2025-08-20 19:31:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:29:09.986586438 (290h3m4.417666569s) [upload=301626]: Starting upload
Aug 20 19:29:09.986635582 (290h3m4.417715713s) [upload=301626]: Done starting upload
Aug 20 19:29:09.986737037 (290h3m4.417817258s) [upload=301626]: Uploading segments...
Aug 20 19:29:09.986826828 (290h3m4.417907049s) [upload=301626]: Got next segment. Inline: false
Aug 20 19:29:09.986899076 (290h3m4.417979287s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:29:09.986909516 (290h3m4.417989678s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:29:10.449938903 (290h3m4.881019034s) [seg_pos={0 0}, upload=301626]: Begin upload segment...
Aug 20 19:29:10.449989208 (290h3m4.881069339s) [seg_pos={0 0}, upload=301626]: Done begin upload segment.
Aug 20 19:29:10.450002224 (290h3m4.881082355s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450019686 (290h3m4.881099817s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450359888 (290h3m4.881440019s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450371700 (290h3m4.881451831s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450714256 (290h3m4.881794387s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451038567 (290h3m4.882118698s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451303313 (290h3m4.882383434s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451733746 (290h3m4.882813878s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452014844 (290h3m4.883094965s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452341589 (290h3m4.88342172s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452609111 (290h3m4.883689243s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452806609 (290h3m4.88388674s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453011461 (290h3m4.884091592s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453237573 (290h3m4.884317704s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453520174 (290h3m4.884600296s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453755975 (290h3m4.884836106s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454264959 (290h3m4.88534509s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454670986 (290h3m4.885751118s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:11.953504725 (290h3m6.384584846s) [upload=301626]: Next returned nil segment
Aug 20 19:29:11.953557877 (290h3m6.384638008s) [upload=301626]: Waiting for error group managing segments...
Aug 20 19:29:12.384942646 (290h3m6.816022767s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.415329336 (290h3m6.846409467s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.424369483 (290h3m6.855449604s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.443355440 (290h3m6.874435561s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.452824077 (290h3m6.883904208s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.469484154 (290h3m6.900564285s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.477834391 (290h3m6.908914522s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.483518136 (290h3m6.914598267s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.508025247 (290h3m6.939105378s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.510723420 (290h3m6.941803551s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.526588837 (290h3m6.957668968s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.538613484 (290h3m6.969693615s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.540997856 (290h3m6.972077998s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551373369 (290h3m6.9824535s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551407153 (290h3m6.982487284s) [seg_pos={0 0}, upload=301626]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:29:12.551557290 (290h3m6.982637421s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551639297 (290h3m6.982719428s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXruuVjtSTQ6AjVR4xV6KRWQbpw6X7CgH5aBU71LX53eNghc1): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551654486 (290h3m6.982734617s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZ945gjHWqLgS2Zccf7NTZCY7RLdnPLUebH2ZPEytMuyjmvvF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551707728 (290h3m6.982787859s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TxoPpye17ET1GR52xy2EmkUdq83x4T9TsfuwrKr8cYXf3HLYt): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551758375 (290h3m6.982838506s) [seg_pos={0 0}, upload=301626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:29:12.551842727 (290h3m6.982922858s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:29:12.551848297 (290h3m6.982928428s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:29:12.981791737 (290h3m7.412871888s) [upload=301626]: Done uploading segments...
Aug 20 19:29:12.981827076 (290h3m7.412907207s) [upload=301626]: Upload finished. err: <nil>
Duration: 6.000428454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.........X.....................] duration:
1.9425376s
FAIL (2025-08-20 19:31:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.94256909s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................X.................X...............X.X...] duration:
5.924151958s
FAIL (2025-08-20 19:31:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:29:09.986586438 (290h3m4.417666569s) [upload=301626]: Starting upload
Aug 20 19:29:09.986635582 (290h3m4.417715713s) [upload=301626]: Done starting upload
Aug 20 19:29:09.986737037 (290h3m4.417817258s) [upload=301626]: Uploading segments...
Aug 20 19:29:09.986826828 (290h3m4.417907049s) [upload=301626]: Got next segment. Inline: false
Aug 20 19:29:09.986899076 (290h3m4.417979287s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:29:09.986909516 (290h3m4.417989678s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:29:10.449938903 (290h3m4.881019034s) [seg_pos={0 0}, upload=301626]: Begin upload segment...
Aug 20 19:29:10.449989208 (290h3m4.881069339s) [seg_pos={0 0}, upload=301626]: Done begin upload segment.
Aug 20 19:29:10.450002224 (290h3m4.881082355s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450019686 (290h3m4.881099817s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450359888 (290h3m4.881440019s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450371700 (290h3m4.881451831s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450714256 (290h3m4.881794387s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451038567 (290h3m4.882118698s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451303313 (290h3m4.882383434s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451733746 (290h3m4.882813878s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452014844 (290h3m4.883094965s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452341589 (290h3m4.88342172s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452609111 (290h3m4.883689243s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452806609 (290h3m4.88388674s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453011461 (290h3m4.884091592s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453237573 (290h3m4.884317704s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453520174 (290h3m4.884600296s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453755975 (290h3m4.884836106s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454264959 (290h3m4.88534509s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454670986 (290h3m4.885751118s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:11.953504725 (290h3m6.384584846s) [upload=301626]: Next returned nil segment
Aug 20 19:29:11.953557877 (290h3m6.384638008s) [upload=301626]: Waiting for error group managing segments...
Aug 20 19:29:12.384942646 (290h3m6.816022767s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.415329336 (290h3m6.846409467s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.424369483 (290h3m6.855449604s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.443355440 (290h3m6.874435561s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.452824077 (290h3m6.883904208s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.469484154 (290h3m6.900564285s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.477834391 (290h3m6.908914522s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.483518136 (290h3m6.914598267s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.508025247 (290h3m6.939105378s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.510723420 (290h3m6.941803551s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.526588837 (290h3m6.957668968s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.538613484 (290h3m6.969693615s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.540997856 (290h3m6.972077998s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551373369 (290h3m6.9824535s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551407153 (290h3m6.982487284s) [seg_pos={0 0}, upload=301626]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:29:12.551557290 (290h3m6.982637421s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551639297 (290h3m6.982719428s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXruuVjtSTQ6AjVR4xV6KRWQbpw6X7CgH5aBU71LX53eNghc1): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551654486 (290h3m6.982734617s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZ945gjHWqLgS2Zccf7NTZCY7RLdnPLUebH2ZPEytMuyjmvvF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551707728 (290h3m6.982787859s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TxoPpye17ET1GR52xy2EmkUdq83x4T9TsfuwrKr8cYXf3HLYt): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551758375 (290h3m6.982838506s) [seg_pos={0 0}, upload=301626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:29:12.551842727 (290h3m6.982922858s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:29:12.551848297 (290h3m6.982928428s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:29:12.981791737 (290h3m7.412871888s) [upload=301626]: Done uploading segments...
Aug 20 19:29:12.981827076 (290h3m7.412907207s) [upload=301626]: Upload finished. err: <nil>
Duration: 5.924225198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.........X....................] duration:
1.88469157s
FAIL (2025-08-20 19:31:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.884792483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.........X...................] duration:
2.009502495s
FAIL (2025-08-20 19:30:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.009530309s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.................X...............X.X..] duration:
6.011262182s
FAIL (2025-08-20 19:30:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:29:09.986586438 (290h3m4.417666569s) [upload=301626]: Starting upload
Aug 20 19:29:09.986635582 (290h3m4.417715713s) [upload=301626]: Done starting upload
Aug 20 19:29:09.986737037 (290h3m4.417817258s) [upload=301626]: Uploading segments...
Aug 20 19:29:09.986826828 (290h3m4.417907049s) [upload=301626]: Got next segment. Inline: false
Aug 20 19:29:09.986899076 (290h3m4.417979287s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:29:09.986909516 (290h3m4.417989678s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:29:10.449938903 (290h3m4.881019034s) [seg_pos={0 0}, upload=301626]: Begin upload segment...
Aug 20 19:29:10.449989208 (290h3m4.881069339s) [seg_pos={0 0}, upload=301626]: Done begin upload segment.
Aug 20 19:29:10.450002224 (290h3m4.881082355s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450019686 (290h3m4.881099817s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450359888 (290h3m4.881440019s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450371700 (290h3m4.881451831s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450714256 (290h3m4.881794387s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451038567 (290h3m4.882118698s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451303313 (290h3m4.882383434s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451733746 (290h3m4.882813878s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452014844 (290h3m4.883094965s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452341589 (290h3m4.88342172s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452609111 (290h3m4.883689243s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452806609 (290h3m4.88388674s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453011461 (290h3m4.884091592s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453237573 (290h3m4.884317704s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453520174 (290h3m4.884600296s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453755975 (290h3m4.884836106s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454264959 (290h3m4.88534509s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454670986 (290h3m4.885751118s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:11.953504725 (290h3m6.384584846s) [upload=301626]: Next returned nil segment
Aug 20 19:29:11.953557877 (290h3m6.384638008s) [upload=301626]: Waiting for error group managing segments...
Aug 20 19:29:12.384942646 (290h3m6.816022767s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.415329336 (290h3m6.846409467s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.424369483 (290h3m6.855449604s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.443355440 (290h3m6.874435561s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.452824077 (290h3m6.883904208s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.469484154 (290h3m6.900564285s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.477834391 (290h3m6.908914522s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.483518136 (290h3m6.914598267s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.508025247 (290h3m6.939105378s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.510723420 (290h3m6.941803551s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.526588837 (290h3m6.957668968s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.538613484 (290h3m6.969693615s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.540997856 (290h3m6.972077998s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551373369 (290h3m6.9824535s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551407153 (290h3m6.982487284s) [seg_pos={0 0}, upload=301626]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:29:12.551557290 (290h3m6.982637421s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551639297 (290h3m6.982719428s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXruuVjtSTQ6AjVR4xV6KRWQbpw6X7CgH5aBU71LX53eNghc1): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551654486 (290h3m6.982734617s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZ945gjHWqLgS2Zccf7NTZCY7RLdnPLUebH2ZPEytMuyjmvvF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551707728 (290h3m6.982787859s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TxoPpye17ET1GR52xy2EmkUdq83x4T9TsfuwrKr8cYXf3HLYt): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551758375 (290h3m6.982838506s) [seg_pos={0 0}, upload=301626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:29:12.551842727 (290h3m6.982922858s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:29:12.551848297 (290h3m6.982928428s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:29:12.981791737 (290h3m7.412871888s) [upload=301626]: Done uploading segments...
Aug 20 19:29:12.981827076 (290h3m7.412907207s) [upload=301626]: Upload finished. err: <nil>
Duration: 6.011308441s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.........X..................] duration:
1.858963092s
FAIL (2025-08-20 19:30:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.858992168s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................X.................X...............X.X.] duration:
5.827419924s
FAIL (2025-08-20 19:30:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:29:09.986586438 (290h3m4.417666569s) [upload=301626]: Starting upload
Aug 20 19:29:09.986635582 (290h3m4.417715713s) [upload=301626]: Done starting upload
Aug 20 19:29:09.986737037 (290h3m4.417817258s) [upload=301626]: Uploading segments...
Aug 20 19:29:09.986826828 (290h3m4.417907049s) [upload=301626]: Got next segment. Inline: false
Aug 20 19:29:09.986899076 (290h3m4.417979287s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:29:09.986909516 (290h3m4.417989678s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:29:10.449938903 (290h3m4.881019034s) [seg_pos={0 0}, upload=301626]: Begin upload segment...
Aug 20 19:29:10.449989208 (290h3m4.881069339s) [seg_pos={0 0}, upload=301626]: Done begin upload segment.
Aug 20 19:29:10.450002224 (290h3m4.881082355s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450019686 (290h3m4.881099817s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450359888 (290h3m4.881440019s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450371700 (290h3m4.881451831s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450714256 (290h3m4.881794387s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451038567 (290h3m4.882118698s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451303313 (290h3m4.882383434s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451733746 (290h3m4.882813878s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452014844 (290h3m4.883094965s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452341589 (290h3m4.88342172s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452609111 (290h3m4.883689243s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452806609 (290h3m4.88388674s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453011461 (290h3m4.884091592s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453237573 (290h3m4.884317704s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453520174 (290h3m4.884600296s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453755975 (290h3m4.884836106s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454264959 (290h3m4.88534509s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454670986 (290h3m4.885751118s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:11.953504725 (290h3m6.384584846s) [upload=301626]: Next returned nil segment
Aug 20 19:29:11.953557877 (290h3m6.384638008s) [upload=301626]: Waiting for error group managing segments...
Aug 20 19:29:12.384942646 (290h3m6.816022767s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.415329336 (290h3m6.846409467s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.424369483 (290h3m6.855449604s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.443355440 (290h3m6.874435561s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.452824077 (290h3m6.883904208s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.469484154 (290h3m6.900564285s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.477834391 (290h3m6.908914522s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.483518136 (290h3m6.914598267s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.508025247 (290h3m6.939105378s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.510723420 (290h3m6.941803551s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.526588837 (290h3m6.957668968s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.538613484 (290h3m6.969693615s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.540997856 (290h3m6.972077998s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551373369 (290h3m6.9824535s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551407153 (290h3m6.982487284s) [seg_pos={0 0}, upload=301626]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:29:12.551557290 (290h3m6.982637421s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551639297 (290h3m6.982719428s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXruuVjtSTQ6AjVR4xV6KRWQbpw6X7CgH5aBU71LX53eNghc1): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551654486 (290h3m6.982734617s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZ945gjHWqLgS2Zccf7NTZCY7RLdnPLUebH2ZPEytMuyjmvvF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551707728 (290h3m6.982787859s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TxoPpye17ET1GR52xy2EmkUdq83x4T9TsfuwrKr8cYXf3HLYt): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551758375 (290h3m6.982838506s) [seg_pos={0 0}, upload=301626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:29:12.551842727 (290h3m6.982922858s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:29:12.551848297 (290h3m6.982928428s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:29:12.981791737 (290h3m7.412871888s) [upload=301626]: Done uploading segments...
Aug 20 19:29:12.981827076 (290h3m7.412907207s) [upload=301626]: Upload finished. err: <nil>
Duration: 5.827446765s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.........X.................] duration:
1.854619551s
FAIL (2025-08-20 19:29:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.85464517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................X.................X...............X.X] duration:
4.164702586s
FAIL (2025-08-20 19:29:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:29:09.986586438 (290h3m4.417666569s) [upload=301626]: Starting upload
Aug 20 19:29:09.986635582 (290h3m4.417715713s) [upload=301626]: Done starting upload
Aug 20 19:29:09.986737037 (290h3m4.417817258s) [upload=301626]: Uploading segments...
Aug 20 19:29:09.986826828 (290h3m4.417907049s) [upload=301626]: Got next segment. Inline: false
Aug 20 19:29:09.986899076 (290h3m4.417979287s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:29:09.986909516 (290h3m4.417989678s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:29:10.449938903 (290h3m4.881019034s) [seg_pos={0 0}, upload=301626]: Begin upload segment...
Aug 20 19:29:10.449989208 (290h3m4.881069339s) [seg_pos={0 0}, upload=301626]: Done begin upload segment.
Aug 20 19:29:10.450002224 (290h3m4.881082355s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450019686 (290h3m4.881099817s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450359888 (290h3m4.881440019s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450371700 (290h3m4.881451831s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.450714256 (290h3m4.881794387s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451038567 (290h3m4.882118698s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451303313 (290h3m4.882383434s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.451733746 (290h3m4.882813878s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452014844 (290h3m4.883094965s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452341589 (290h3m4.88342172s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452609111 (290h3m4.883689243s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.452806609 (290h3m4.88388674s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453011461 (290h3m4.884091592s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453237573 (290h3m4.884317704s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453520174 (290h3m4.884600296s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.453755975 (290h3m4.884836106s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454264959 (290h3m4.88534509s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:10.454670986 (290h3m4.885751118s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Uploading piece...
Aug 20 19:29:11.953504725 (290h3m6.384584846s) [upload=301626]: Next returned nil segment
Aug 20 19:29:11.953557877 (290h3m6.384638008s) [upload=301626]: Waiting for error group managing segments...
Aug 20 19:29:12.384942646 (290h3m6.816022767s) [noise=true , address=77.90.31.16:4752 , piece_id=7OPTKITAP2XR6MNARI7GBZIKRSPOC3AMRIOSXQJ52W7ZLOK3DY3Q, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.415329336 (290h3m6.846409467s) [noise=true , address=104.36.82.45:4917 , piece_id=Q24BJ64ABSQ2D7SSJLBPJPCQQZF4YXZL2UZCXPSYMQW7XMXZJATA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.424369483 (290h3m6.855449604s) [noise=true , address=45.91.116.11:4131 , piece_id=4R3RXN3LNE2HKKCHJMKLFKUO3NZ3OTXAYD32JD62EBK3IJR6GOVQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.443355440 (290h3m6.874435561s) [noise=true , address=104.36.82.3:4772 , piece_id=DWUV52U4NOZ2RIILJYQS4GYI4CFJ7DSSMRH6B33BY2D6ALZAQZXQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.452824077 (290h3m6.883904208s) [noise=true , address=45.91.116.14:4209 , piece_id=DRQTPCJ4G6XJYKTGNTOI5TD6NPYUMCK3TEDRZVYD3V4BMROZE6JQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.469484154 (290h3m6.900564285s) [noise=true , address=77.90.31.18:4813 , piece_id=H4NDFYVNFCLF5M5J6YCL26MR3EKFQW2PB2X4VUC4INVO5KLDLNGA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.477834391 (290h3m6.908914522s) [noise=true , address=104.36.82.44:4881 , piece_id=N36AQS7CRW6C6RZKBRTWWB7G2HRNOSHBWGALZD5SKZUQHDUWWINQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.483518136 (290h3m6.914598267s) [noise=true , address=104.36.82.2:4739 , piece_id=TFJDAVLESKUIICFGDVWGGPCQTBLFMJVQP4DNGPCGVJXKMB6FSSYA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.508025247 (290h3m6.939105378s) [noise=true , address=104.36.82.23:4470 , piece_id=ON4ZB5HAFP7ZWZON6D567NQH6NZEI6VKNZON4UYGR72DYIOYNV5A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.510723420 (290h3m6.941803551s) [noise=true , address=77.90.31.10:4542 , piece_id=BBUYJ4W5HDRFXWLV7T7RLHQZOETHFWOD2WWAWGJ7AAV6HYRE76MA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.526588837 (290h3m6.957668968s) [noise=true , address=77.90.31.11:4582 , piece_id=JEYWDHQNWAVY76PMLDD7DZG5TWUZGFLY3IRMQVDXEKLXLTHQEPWQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.538613484 (290h3m6.969693615s) [noise=true , address=77.90.31.19:4855 , piece_id=BDU3TTCQF67MCKHGT43BVKPIOGO7ICRFLZDC56RCTNOTSFL3GWTQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.540997856 (290h3m6.972077998s) [noise=true , address=104.36.82.60:4358 , piece_id=6YJOXXYDJP7DXHQMEEVSKXS2EHO7JB724LIIXMCGHSKLIBOJNOLQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551373369 (290h3m6.9824535s) [noise=true , address=45.91.116.4:4943 , piece_id=544PEIVN4QQEPWAMCXNXQM5OF7QUBM3O2I44QPFQI7SBZEEVHLXA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: <nil>
Aug 20 19:29:12.551407153 (290h3m6.982487284s) [seg_pos={0 0}, upload=301626]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:29:12.551557290 (290h3m6.982637421s) [noise=true , address=45.91.116.9:4277 , piece_id=LGYCDRGWV6EQ3VBEGLI2YO2B6DDSP45Q5WRTHD2UXTTMFD62EAMQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551639297 (290h3m6.982719428s) [noise=true , address=45.91.116.10:4102 , piece_id=43MO4B6PCVTC6JTIZ5KRCJRSXUT4TOBFT5F5O6IDJYYAHAQSMX6A, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXruuVjtSTQ6AjVR4xV6KRWQbpw6X7CgH5aBU71LX53eNghc1): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551654486 (290h3m6.982734617s) [noise=true , address=104.36.82.8:4986 , piece_id=HGC7OCMOG4JPFPTQFSYHDJ34Q6STYKQRWYDYCWL7N5UIO3VBUWVA, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZ945gjHWqLgS2Zccf7NTZCY7RLdnPLUebH2ZPEytMuyjmvvF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551707728 (290h3m6.982787859s) [noise=true , address=77.90.31.17:4800 , piece_id=WK4UVZRFX3TS2263MND6NRH2FWKTK44SWE4MPIM7MND7MKQUPYOQ, seg_pos={0 0}, upload=301626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TxoPpye17ET1GR52xy2EmkUdq83x4T9TsfuwrKr8cYXf3HLYt): protocol: expected piece hash; context canceled; EOF
Aug 20 19:29:12.551758375 (290h3m6.982838506s) [seg_pos={0 0}, upload=301626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:29:12.551842727 (290h3m6.982922858s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:29:12.551848297 (290h3m6.982928428s) [upload=301626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:29:12.981791737 (290h3m7.412871888s) [upload=301626]: Done uploading segments...
Aug 20 19:29:12.981827076 (290h3m7.412907207s) [upload=301626]: Upload finished. err: <nil>
Duration: 4.164729328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.........X................] duration:
1.975018751s
FAIL (2025-08-20 19:29:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.975046853s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X.................X...............X.] duration:
5.788256061s
FAIL (2025-08-20 19:28:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:27:39.542137407 (290h1m33.973217538s) [upload=301599]: Starting upload
Aug 20 19:27:39.542200958 (290h1m33.973281079s) [upload=301599]: Done starting upload
Aug 20 19:27:39.542239532 (290h1m33.973319663s) [upload=301599]: Uploading segments...
Aug 20 19:27:39.542413415 (290h1m33.973493536s) [upload=301599]: Got next segment. Inline: false
Aug 20 19:27:39.542439795 (290h1m33.973519916s) [upload=301599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:27:39.542444003 (290h1m33.973524134s) [upload=301599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:27:40.022986496 (290h1m34.454066627s) [seg_pos={0 0}, upload=301599]: Begin upload segment...
Aug 20 19:27:40.023041361 (290h1m34.454121492s) [seg_pos={0 0}, upload=301599]: Done begin upload segment.
Aug 20 19:27:40.023064756 (290h1m34.454144887s) [noise=true , address=104.36.82.41:4765 , piece_id=2CUW4HTC4EISD2J5EFQ25M3TMK7AAGXEM444VQHK4QI2EUB6POXA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.023096727 (290h1m34.454176858s) [noise=true , address=104.36.82.19:4431 , piece_id=P66NWBARMN7OM2BD4PDS4SDZCLWG4QR4QTAIJVFG6LMTTKXHLDVQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.023439283 (290h1m34.454519404s) [noise=true , address=45.91.116.11:4125 , piece_id=CNWYN4Y7JDCMAHIRKH7IKSOAWDF7AJMNNCCXUL2KKK7ELOBIZNOA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.023737975 (290h1m34.454818096s) [noise=true , address=77.90.31.11:4556 , piece_id=O52POFDZNL2BADE2AZCYT5NGFZEDNZ7AVVXVASFE7FVBSFJAKHUQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.023753544 (290h1m34.454833725s) [noise=true , address=104.36.82.51:4065 , piece_id=RTLO3QNN6INLEZ7LCGIBSCQVLFQ5NEEYXOTTZYUIAOFPGP7A3RDQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.024027418 (290h1m34.455107539s) [noise=true , address=45.91.116.8:4062 , piece_id=DX2PWD225NFWQTYVBAMZOKNIUESEJ7YUDGO5TRWLRAZ7JJ3JDNPA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.024375755 (290h1m34.455455886s) [noise=true , address=104.36.82.23:4476 , piece_id=MYQCLADXMWMQTMC3JBLUIVOC6HZ5AEQZ43BMCFBXWU4QAJROBI5Q, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.024669898 (290h1m34.455750029s) [noise=true , address=45.91.116.8:4075 , piece_id=7D7YXFCRHOHUTZR276R35NPBOWGVQXTE33BRYNHTDGLFSAHTDLWA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.024927080 (290h1m34.456007211s) [noise=true , address=104.36.82.13:4196 , piece_id=YOAQQPTJPGTSAXJIG3OZFNYGF3CXHLTUYAIY6BGR56JV54X7NCYA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.025162671 (290h1m34.456242802s) [noise=true , address=104.36.82.10:4107 , piece_id=DRXKTXQFFSDLRTUBOHU5KUWONLXB7KGSOX5M6PHSCRJB24DKQLFQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.025467524 (290h1m34.456547655s) [noise=true , address=77.90.31.16:4743 , piece_id=BJIOHV7MNIFJSPUXCPFKKXOWWOAM7WUL2ONKK6GZHOLDYFOEFJRQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.025742680 (290h1m34.456822811s) [noise=true , address=104.36.82.40:4955 , piece_id=2DUIPJI5PE4SWHNTUSQALUSP73AGLP55TX2DONZG4EGMXEPBSQKQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026025341 (290h1m34.457105472s) [noise=true , address=104.36.82.39:4747 , piece_id=5PINHHYAVCEGKC3KICHFWGC6IULKKBEVL574KUEOOZ7WN2RVUPWA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026224783 (290h1m34.457304904s) [noise=true , address=104.36.82.49:4990 , piece_id=IWHC2A5WKQB2ZVBTVCJRWNTJWVEX6UOTWJEWTSTMBN2HX75QXDKQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026263848 (290h1m34.457343969s) [noise=true , address=104.36.82.5:4851 , piece_id=VUQQH7D3JENGSXYZHN3P3SPZDYCOMWVLED2PKAEPAORHS6IJO47A, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026540878 (290h1m34.457621019s) [noise=true , address=104.36.82.22:4540 , piece_id=HRACCAASQZ7C5YPYFHFMAGV6F5SKG4OTMDIN4QUZOADGXTTSFP7Q, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026754306 (290h1m34.457834437s) [noise=true , address=77.90.31.15:4721 , piece_id=UNXZUPEPDPFQDF35NFJCV75PJRGL6T4SYGTGRS5YIAVPEOAXXIQQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026986049 (290h1m34.45806618s) [noise=true , address=104.36.82.45:4940 , piece_id=WRHR3VOHP6RAZ6OOOCRGMWJ3RKYN5CWQA54XLR2K4JNLWCDEQC3A, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:41.543176902 (290h1m35.974257033s) [upload=301599]: Next returned nil segment
Aug 20 19:27:41.543194747 (290h1m35.974274878s) [upload=301599]: Waiting for error group managing segments...
Aug 20 19:27:41.963690099 (290h1m36.39477022s) [noise=true , address=77.90.31.15:4721 , piece_id=UNXZUPEPDPFQDF35NFJCV75PJRGL6T4SYGTGRS5YIAVPEOAXXIQQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:41.965895869 (290h1m36.396976s) [noise=true , address=104.36.82.49:4990 , piece_id=IWHC2A5WKQB2ZVBTVCJRWNTJWVEX6UOTWJEWTSTMBN2HX75QXDKQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:41.990630215 (290h1m36.421710346s) [noise=true , address=104.36.82.22:4540 , piece_id=HRACCAASQZ7C5YPYFHFMAGV6F5SKG4OTMDIN4QUZOADGXTTSFP7Q, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:41.998450638 (290h1m36.42953077s) [noise=true , address=45.91.116.11:4125 , piece_id=CNWYN4Y7JDCMAHIRKH7IKSOAWDF7AJMNNCCXUL2KKK7ELOBIZNOA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.000569763 (290h1m36.431649904s) [noise=true , address=104.36.82.10:4107 , piece_id=DRXKTXQFFSDLRTUBOHU5KUWONLXB7KGSOX5M6PHSCRJB24DKQLFQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.037468224 (290h1m36.468548355s) [noise=true , address=45.91.116.8:4062 , piece_id=DX2PWD225NFWQTYVBAMZOKNIUESEJ7YUDGO5TRWLRAZ7JJ3JDNPA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.041097908 (290h1m36.47217803s) [noise=true , address=104.36.82.13:4196 , piece_id=YOAQQPTJPGTSAXJIG3OZFNYGF3CXHLTUYAIY6BGR56JV54X7NCYA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.045267957 (290h1m36.476348088s) [noise=true , address=45.91.116.8:4075 , piece_id=7D7YXFCRHOHUTZR276R35NPBOWGVQXTE33BRYNHTDGLFSAHTDLWA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.045898073 (290h1m36.476978194s) [noise=true , address=104.36.82.51:4065 , piece_id=RTLO3QNN6INLEZ7LCGIBSCQVLFQ5NEEYXOTTZYUIAOFPGP7A3RDQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.054383078 (290h1m36.485463199s) [noise=true , address=104.36.82.45:4940 , piece_id=WRHR3VOHP6RAZ6OOOCRGMWJ3RKYN5CWQA54XLR2K4JNLWCDEQC3A, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.074335184 (290h1m36.505415305s) [noise=true , address=104.36.82.5:4851 , piece_id=VUQQH7D3JENGSXYZHN3P3SPZDYCOMWVLED2PKAEPAORHS6IJO47A, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.091447246 (290h1m36.522527377s) [noise=true , address=104.36.82.40:4955 , piece_id=2DUIPJI5PE4SWHNTUSQALUSP73AGLP55TX2DONZG4EGMXEPBSQKQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.093554087 (290h1m36.524634218s) [noise=true , address=104.36.82.41:4765 , piece_id=2CUW4HTC4EISD2J5EFQ25M3TMK7AAGXEM444VQHK4QI2EUB6POXA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.096590216 (290h1m36.527670347s) [noise=true , address=104.36.82.19:4431 , piece_id=P66NWBARMN7OM2BD4PDS4SDZCLWG4QR4QTAIJVFG6LMTTKXHLDVQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.096653527 (290h1m36.527733668s) [seg_pos={0 0}, upload=301599]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:27:42.096788846 (290h1m36.527868977s) [noise=true , address=77.90.31.11:4556 , piece_id=O52POFDZNL2BADE2AZCYT5NGFZEDNZ7AVVXVASFE7FVBSFJAKHUQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks): protocol: expected piece hash; context canceled; EOF
Aug 20 19:27:42.096807582 (290h1m36.527887723s) [noise=true , address=104.36.82.39:4747 , piece_id=5PINHHYAVCEGKC3KICHFWGC6IULKKBEVL574KUEOOZ7WN2RVUPWA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 20 19:27:42.096874349 (290h1m36.52795448s) [noise=true , address=77.90.31.16:4743 , piece_id=BJIOHV7MNIFJSPUXCPFKKXOWWOAM7WUL2ONKK6GZHOLDYFOEFJRQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XLPBKV4R1CLgVK32nSQffKHxjhU7XsGo8MEsHaAbDGiusTTAv): protocol: expected piece hash; context canceled; EOF
Aug 20 19:27:42.096919536 (290h1m36.527999667s) [noise=true , address=104.36.82.23:4476 , piece_id=MYQCLADXMWMQTMC3JBLUIVOC6HZ5AEQZ43BMCFBXWU4QAJROBI5Q, seg_pos={0 0}, upload=301599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:27:42.096942510 (290h1m36.528022651s) [seg_pos={0 0}, upload=301599]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:27:42.097023665 (290h1m36.528103806s) [upload=301599]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:27:42.097029055 (290h1m36.528109196s) [upload=301599]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:27:42.528973534 (290h1m36.960053666s) [upload=301599]: Done uploading segments...
Aug 20 19:27:42.528995106 (290h1m36.960075237s) [upload=301599]: Upload finished. err: <nil>
Duration: 5.788295757s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.........X...............] duration:
1.848749309s
FAIL (2025-08-20 19:28:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.848779478s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.................X...............X] duration:
4.084099338s
FAIL (2025-08-20 19:27:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:27:39.542137407 (290h1m33.973217538s) [upload=301599]: Starting upload
Aug 20 19:27:39.542200958 (290h1m33.973281079s) [upload=301599]: Done starting upload
Aug 20 19:27:39.542239532 (290h1m33.973319663s) [upload=301599]: Uploading segments...
Aug 20 19:27:39.542413415 (290h1m33.973493536s) [upload=301599]: Got next segment. Inline: false
Aug 20 19:27:39.542439795 (290h1m33.973519916s) [upload=301599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:27:39.542444003 (290h1m33.973524134s) [upload=301599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:27:40.022986496 (290h1m34.454066627s) [seg_pos={0 0}, upload=301599]: Begin upload segment...
Aug 20 19:27:40.023041361 (290h1m34.454121492s) [seg_pos={0 0}, upload=301599]: Done begin upload segment.
Aug 20 19:27:40.023064756 (290h1m34.454144887s) [noise=true , address=104.36.82.41:4765 , piece_id=2CUW4HTC4EISD2J5EFQ25M3TMK7AAGXEM444VQHK4QI2EUB6POXA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.023096727 (290h1m34.454176858s) [noise=true , address=104.36.82.19:4431 , piece_id=P66NWBARMN7OM2BD4PDS4SDZCLWG4QR4QTAIJVFG6LMTTKXHLDVQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.023439283 (290h1m34.454519404s) [noise=true , address=45.91.116.11:4125 , piece_id=CNWYN4Y7JDCMAHIRKH7IKSOAWDF7AJMNNCCXUL2KKK7ELOBIZNOA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.023737975 (290h1m34.454818096s) [noise=true , address=77.90.31.11:4556 , piece_id=O52POFDZNL2BADE2AZCYT5NGFZEDNZ7AVVXVASFE7FVBSFJAKHUQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.023753544 (290h1m34.454833725s) [noise=true , address=104.36.82.51:4065 , piece_id=RTLO3QNN6INLEZ7LCGIBSCQVLFQ5NEEYXOTTZYUIAOFPGP7A3RDQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.024027418 (290h1m34.455107539s) [noise=true , address=45.91.116.8:4062 , piece_id=DX2PWD225NFWQTYVBAMZOKNIUESEJ7YUDGO5TRWLRAZ7JJ3JDNPA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.024375755 (290h1m34.455455886s) [noise=true , address=104.36.82.23:4476 , piece_id=MYQCLADXMWMQTMC3JBLUIVOC6HZ5AEQZ43BMCFBXWU4QAJROBI5Q, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.024669898 (290h1m34.455750029s) [noise=true , address=45.91.116.8:4075 , piece_id=7D7YXFCRHOHUTZR276R35NPBOWGVQXTE33BRYNHTDGLFSAHTDLWA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.024927080 (290h1m34.456007211s) [noise=true , address=104.36.82.13:4196 , piece_id=YOAQQPTJPGTSAXJIG3OZFNYGF3CXHLTUYAIY6BGR56JV54X7NCYA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.025162671 (290h1m34.456242802s) [noise=true , address=104.36.82.10:4107 , piece_id=DRXKTXQFFSDLRTUBOHU5KUWONLXB7KGSOX5M6PHSCRJB24DKQLFQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.025467524 (290h1m34.456547655s) [noise=true , address=77.90.31.16:4743 , piece_id=BJIOHV7MNIFJSPUXCPFKKXOWWOAM7WUL2ONKK6GZHOLDYFOEFJRQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.025742680 (290h1m34.456822811s) [noise=true , address=104.36.82.40:4955 , piece_id=2DUIPJI5PE4SWHNTUSQALUSP73AGLP55TX2DONZG4EGMXEPBSQKQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026025341 (290h1m34.457105472s) [noise=true , address=104.36.82.39:4747 , piece_id=5PINHHYAVCEGKC3KICHFWGC6IULKKBEVL574KUEOOZ7WN2RVUPWA, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026224783 (290h1m34.457304904s) [noise=true , address=104.36.82.49:4990 , piece_id=IWHC2A5WKQB2ZVBTVCJRWNTJWVEX6UOTWJEWTSTMBN2HX75QXDKQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026263848 (290h1m34.457343969s) [noise=true , address=104.36.82.5:4851 , piece_id=VUQQH7D3JENGSXYZHN3P3SPZDYCOMWVLED2PKAEPAORHS6IJO47A, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026540878 (290h1m34.457621019s) [noise=true , address=104.36.82.22:4540 , piece_id=HRACCAASQZ7C5YPYFHFMAGV6F5SKG4OTMDIN4QUZOADGXTTSFP7Q, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026754306 (290h1m34.457834437s) [noise=true , address=77.90.31.15:4721 , piece_id=UNXZUPEPDPFQDF35NFJCV75PJRGL6T4SYGTGRS5YIAVPEOAXXIQQ, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:40.026986049 (290h1m34.45806618s) [noise=true , address=104.36.82.45:4940 , piece_id=WRHR3VOHP6RAZ6OOOCRGMWJ3RKYN5CWQA54XLR2K4JNLWCDEQC3A, seg_pos={0 0}, upload=301599]: Uploading piece...
Aug 20 19:27:41.543176902 (290h1m35.974257033s) [upload=301599]: Next returned nil segment
Aug 20 19:27:41.543194747 (290h1m35.974274878s) [upload=301599]: Waiting for error group managing segments...
Aug 20 19:27:41.963690099 (290h1m36.39477022s) [noise=true , address=77.90.31.15:4721 , piece_id=UNXZUPEPDPFQDF35NFJCV75PJRGL6T4SYGTGRS5YIAVPEOAXXIQQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:41.965895869 (290h1m36.396976s) [noise=true , address=104.36.82.49:4990 , piece_id=IWHC2A5WKQB2ZVBTVCJRWNTJWVEX6UOTWJEWTSTMBN2HX75QXDKQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:41.990630215 (290h1m36.421710346s) [noise=true , address=104.36.82.22:4540 , piece_id=HRACCAASQZ7C5YPYFHFMAGV6F5SKG4OTMDIN4QUZOADGXTTSFP7Q, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:41.998450638 (290h1m36.42953077s) [noise=true , address=45.91.116.11:4125 , piece_id=CNWYN4Y7JDCMAHIRKH7IKSOAWDF7AJMNNCCXUL2KKK7ELOBIZNOA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.000569763 (290h1m36.431649904s) [noise=true , address=104.36.82.10:4107 , piece_id=DRXKTXQFFSDLRTUBOHU5KUWONLXB7KGSOX5M6PHSCRJB24DKQLFQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.037468224 (290h1m36.468548355s) [noise=true , address=45.91.116.8:4062 , piece_id=DX2PWD225NFWQTYVBAMZOKNIUESEJ7YUDGO5TRWLRAZ7JJ3JDNPA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.041097908 (290h1m36.47217803s) [noise=true , address=104.36.82.13:4196 , piece_id=YOAQQPTJPGTSAXJIG3OZFNYGF3CXHLTUYAIY6BGR56JV54X7NCYA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.045267957 (290h1m36.476348088s) [noise=true , address=45.91.116.8:4075 , piece_id=7D7YXFCRHOHUTZR276R35NPBOWGVQXTE33BRYNHTDGLFSAHTDLWA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.045898073 (290h1m36.476978194s) [noise=true , address=104.36.82.51:4065 , piece_id=RTLO3QNN6INLEZ7LCGIBSCQVLFQ5NEEYXOTTZYUIAOFPGP7A3RDQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.054383078 (290h1m36.485463199s) [noise=true , address=104.36.82.45:4940 , piece_id=WRHR3VOHP6RAZ6OOOCRGMWJ3RKYN5CWQA54XLR2K4JNLWCDEQC3A, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.074335184 (290h1m36.505415305s) [noise=true , address=104.36.82.5:4851 , piece_id=VUQQH7D3JENGSXYZHN3P3SPZDYCOMWVLED2PKAEPAORHS6IJO47A, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.091447246 (290h1m36.522527377s) [noise=true , address=104.36.82.40:4955 , piece_id=2DUIPJI5PE4SWHNTUSQALUSP73AGLP55TX2DONZG4EGMXEPBSQKQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.093554087 (290h1m36.524634218s) [noise=true , address=104.36.82.41:4765 , piece_id=2CUW4HTC4EISD2J5EFQ25M3TMK7AAGXEM444VQHK4QI2EUB6POXA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.096590216 (290h1m36.527670347s) [noise=true , address=104.36.82.19:4431 , piece_id=P66NWBARMN7OM2BD4PDS4SDZCLWG4QR4QTAIJVFG6LMTTKXHLDVQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: <nil>
Aug 20 19:27:42.096653527 (290h1m36.527733668s) [seg_pos={0 0}, upload=301599]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:27:42.096788846 (290h1m36.527868977s) [noise=true , address=77.90.31.11:4556 , piece_id=O52POFDZNL2BADE2AZCYT5NGFZEDNZ7AVVXVASFE7FVBSFJAKHUQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks): protocol: expected piece hash; context canceled; EOF
Aug 20 19:27:42.096807582 (290h1m36.527887723s) [noise=true , address=104.36.82.39:4747 , piece_id=5PINHHYAVCEGKC3KICHFWGC6IULKKBEVL574KUEOOZ7WN2RVUPWA, seg_pos={0 0}, upload=301599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 20 19:27:42.096874349 (290h1m36.52795448s) [noise=true , address=77.90.31.16:4743 , piece_id=BJIOHV7MNIFJSPUXCPFKKXOWWOAM7WUL2ONKK6GZHOLDYFOEFJRQ, seg_pos={0 0}, upload=301599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XLPBKV4R1CLgVK32nSQffKHxjhU7XsGo8MEsHaAbDGiusTTAv): protocol: expected piece hash; context canceled; EOF
Aug 20 19:27:42.096919536 (290h1m36.527999667s) [noise=true , address=104.36.82.23:4476 , piece_id=MYQCLADXMWMQTMC3JBLUIVOC6HZ5AEQZ43BMCFBXWU4QAJROBI5Q, seg_pos={0 0}, upload=301599]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:27:42.096942510 (290h1m36.528022651s) [seg_pos={0 0}, upload=301599]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:27:42.097023665 (290h1m36.528103806s) [upload=301599]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:27:42.097029055 (290h1m36.528109196s) [upload=301599]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:27:42.528973534 (290h1m36.960053666s) [upload=301599]: Done uploading segments...
Aug 20 19:27:42.528995106 (290h1m36.960075237s) [upload=301599]: Upload finished. err: <nil>
Duration: 4.084124085s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.........X..............] duration:
2.060867182s
FAIL (2025-08-20 19:27:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.060901256s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.................X...............] duration:
6.229239829s
FAIL (2025-08-20 19:26:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:17:46.972467268 (289h51m41.403547399s) [upload=301431]: Starting upload
Aug 20 19:17:46.972515501 (289h51m41.403595632s) [upload=301431]: Done starting upload
Aug 20 19:17:46.972672722 (289h51m41.403752853s) [upload=301431]: Uploading segments...
Aug 20 19:17:46.972790186 (289h51m41.403870317s) [upload=301431]: Got next segment. Inline: false
Aug 20 19:17:46.972866983 (289h51m41.403947114s) [upload=301431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:17:46.972872474 (289h51m41.403952595s) [upload=301431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:17:47.432147517 (289h51m41.863227638s) [seg_pos={0 0}, upload=301431]: Begin upload segment...
Aug 20 19:17:47.432192893 (289h51m41.863273014s) [seg_pos={0 0}, upload=301431]: Done begin upload segment.
Aug 20 19:17:47.432218292 (289h51m41.863298423s) [noise=true , address=77.90.31.18:4836 , piece_id=E3TXBIJCBDVJTVYOCNCKQOME54L3SDMF4NPJET5LWFERO4BJU7PQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.432414958 (289h51m41.863495089s) [noise=true , address=104.36.82.51:4083 , piece_id=PDCKFPAUPWSRVBCW4OBGURQYA5RIFZIYYIU7G3YBKFR7JWL5L3IQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.432559826 (289h51m41.863639957s) [noise=true , address=45.91.116.10:4089 , piece_id=JLDU6SPMA3ONLLARWQQWJBJO2UQWNNB46Z7VAYND46Z66BSCXZEQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.432837868 (289h51m41.863917999s) [noise=true , address=77.90.31.21:4911 , piece_id=FUBGHZCVRQVDCLU25GANI56PPLH3FS2RGJ22G5BA3JRKUSQGJ5QA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.432968428 (289h51m41.864048559s) [noise=true , address=77.90.31.11:4562 , piece_id=XXHQFNGK6LLJO62SIHYSTZC32MRCUMUI5ZSTJ5IXIKF76WIXYSWA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433092705 (289h51m41.864172836s) [noise=true , address=104.36.82.23:4456 , piece_id=RYYNOZVRTQAWAPCMWTV57Q64SSKAPELJHRQNU6JT4VLTBVDQCHEQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433296324 (289h51m41.864376456s) [noise=true , address=45.91.116.5:4327 , piece_id=CYMBM6LPKHEAPGSUDE45MK6XQ6QPN2CXX2H5QFWGTWTGHXONWHPA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433483763 (289h51m41.864563894s) [noise=true , address=104.36.82.52:4086 , piece_id=YJ55YBLWTDFXO2NRJAANAJMXFI5GTYAKO7GMJP7QZHJRAZPDVIGQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433612219 (289h51m41.86469235s) [noise=true , address=45.91.116.13:4180 , piece_id=Y47F7EWYAGQZTMT7VW5WGUMGGESCXNXF32QQLT2KYHCZMHSSCZQA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433794218 (289h51m41.864891271s) [noise=true , address=104.36.82.34:4577 , piece_id=THAXTJNZKV4BRRQDDBAKU6K2X7KS7CEKBBSCMDLXS2GUD7SCNDLA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434031882 (289h51m41.865112013s) [noise=true , address=104.36.82.6:4890 , piece_id=MGCKKJND4UE2U5KFTFVABTYXPYYBAAAD2MLTPKHJMWQQSD45TWFQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434123268 (289h51m41.865203399s) [noise=true , address=79.127.205.245:4231 , piece_id=H3TV5VNST3YQ2HN4Q6XD4CPYP26ENSTCQITQCKIGB7P7TGJB4ERA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434226164 (289h51m41.865306295s) [noise=true , address=104.36.82.37:4678 , piece_id=FFBXYGH6R5AUAEHYFFL2H2KEK65BUAYAC3OJXCYVFKTFBDF3M7DQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434410256 (289h51m41.865490377s) [noise=true , address=104.36.82.18:4388 , piece_id=TMIDS5SSKH46IDFWJSUYHVITVQYGPGODMBRJL2EDUDFQPXO76U5A, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434428141 (289h51m41.865508272s) [noise=true , address=77.90.31.14:4675 , piece_id=G3HCBJTA5H6IGR7J4ZUGLMWTQSF5GJGM4XERCL7CKN7IVOHGFJWQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434675735 (289h51m41.865755866s) [noise=true , address=77.90.31.19:4851 , piece_id=V77JQGYNM374ZVC5OSHWF722JHXGBXAJHKISWPWSD432WVL3RQYQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434934950 (289h51m41.866015081s) [noise=true , address=104.36.82.60:4343 , piece_id=SRGSF2Q7JQKPAJXIPG6J2YYBCZ7NBWHYIWL6KWBNOOGAWCJ7GV5Q, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.435186010 (289h51m41.866266131s) [noise=true , address=104.36.82.50:4014 , piece_id=42C5TT7XNYYPTV4ZTG5POKQ6UAVCIRKYEABFLCJOWW6N56T2E4MQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:48.563697449 (289h51m42.99477758s) [upload=301431]: Next returned nil segment
Aug 20 19:17:48.563715143 (289h51m42.994795274s) [upload=301431]: Waiting for error group managing segments...
Aug 20 19:17:48.856062109 (289h51m43.28714224s) [noise=true , address=79.127.205.245:4231 , piece_id=H3TV5VNST3YQ2HN4Q6XD4CPYP26ENSTCQITQCKIGB7P7TGJB4ERA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.337707166 (289h51m43.768787287s) [noise=true , address=45.91.116.13:4180 , piece_id=Y47F7EWYAGQZTMT7VW5WGUMGGESCXNXF32QQLT2KYHCZMHSSCZQA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.353481046 (289h51m43.784561167s) [noise=true , address=104.36.82.37:4678 , piece_id=FFBXYGH6R5AUAEHYFFL2H2KEK65BUAYAC3OJXCYVFKTFBDF3M7DQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.374078417 (289h51m43.805158548s) [noise=true , address=104.36.82.51:4083 , piece_id=PDCKFPAUPWSRVBCW4OBGURQYA5RIFZIYYIU7G3YBKFR7JWL5L3IQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.402755235 (289h51m43.833835366s) [noise=true , address=77.90.31.21:4911 , piece_id=FUBGHZCVRQVDCLU25GANI56PPLH3FS2RGJ22G5BA3JRKUSQGJ5QA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.420008197 (289h51m43.851088328s) [noise=true , address=104.36.82.52:4086 , piece_id=YJ55YBLWTDFXO2NRJAANAJMXFI5GTYAKO7GMJP7QZHJRAZPDVIGQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.430140934 (289h51m43.861221075s) [noise=true , address=77.90.31.18:4836 , piece_id=E3TXBIJCBDVJTVYOCNCKQOME54L3SDMF4NPJET5LWFERO4BJU7PQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.438203271 (289h51m43.869283402s) [noise=true , address=104.36.82.50:4014 , piece_id=42C5TT7XNYYPTV4ZTG5POKQ6UAVCIRKYEABFLCJOWW6N56T2E4MQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.457487438 (289h51m43.888567569s) [noise=true , address=45.91.116.10:4089 , piece_id=JLDU6SPMA3ONLLARWQQWJBJO2UQWNNB46Z7VAYND46Z66BSCXZEQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.472330969 (289h51m43.9034111s) [noise=true , address=104.36.82.60:4343 , piece_id=SRGSF2Q7JQKPAJXIPG6J2YYBCZ7NBWHYIWL6KWBNOOGAWCJ7GV5Q, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.491775514 (289h51m43.922855645s) [noise=true , address=104.36.82.34:4577 , piece_id=THAXTJNZKV4BRRQDDBAKU6K2X7KS7CEKBBSCMDLXS2GUD7SCNDLA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.492262116 (289h51m43.923342247s) [noise=true , address=104.36.82.6:4890 , piece_id=MGCKKJND4UE2U5KFTFVABTYXPYYBAAAD2MLTPKHJMWQQSD45TWFQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.503727493 (289h51m43.934807614s) [noise=true , address=77.90.31.11:4562 , piece_id=XXHQFNGK6LLJO62SIHYSTZC32MRCUMUI5ZSTJ5IXIKF76WIXYSWA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.526369816 (289h51m43.957449937s) [noise=true , address=77.90.31.14:4675 , piece_id=G3HCBJTA5H6IGR7J4ZUGLMWTQSF5GJGM4XERCL7CKN7IVOHGFJWQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.526396057 (289h51m43.957476188s) [seg_pos={0 0}, upload=301431]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:17:49.526584427 (289h51m43.957664558s) [noise=true , address=104.36.82.23:4456 , piece_id=RYYNOZVRTQAWAPCMWTV57Q64SSKAPELJHRQNU6JT4VLTBVDQCHEQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: expected piece hash; context canceled; EOF
Aug 20 19:17:49.526592082 (289h51m43.957672233s) [noise=true , address=104.36.82.18:4388 , piece_id=TMIDS5SSKH46IDFWJSUYHVITVQYGPGODMBRJL2EDUDFQPXO76U5A, seg_pos={0 0}, upload=301431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PSQi81UGvRAmTRKhLyyJw2DmYW44xos3uNgpAbZ6hEa5udKtb): protocol: expected piece hash; context canceled; EOF
Aug 20 19:17:49.526610086 (289h51m43.957690217s) [noise=true , address=45.91.116.5:4327 , piece_id=CYMBM6LPKHEAPGSUDE45MK6XQ6QPN2CXX2H5QFWGTWTGHXONWHPA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HY8UAuJNnivgSkxwNfFETRLrFFCtAnGsjkGHVvby1KCycDzSm): protocol: expected piece hash; context canceled; EOF
Aug 20 19:17:49.526677355 (289h51m43.957757576s) [noise=true , address=77.90.31.19:4851 , piece_id=V77JQGYNM374ZVC5OSHWF722JHXGBXAJHKISWPWSD432WVL3RQYQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEV2ndHw4fohVUNsfrzwojd8S11TmMST6Sz59GVnXS8vDGhWk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:17:49.526706320 (289h51m43.957786491s) [seg_pos={0 0}, upload=301431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:17:49.526788337 (289h51m43.957868498s) [upload=301431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:17:49.526795781 (289h51m43.957875932s) [upload=301431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:17:49.900027601 (289h51m44.331107782s) [upload=301431]: Done uploading segments...
Aug 20 19:17:49.900050484 (289h51m44.331130625s) [upload=301431]: Upload finished. err: <nil>
Duration: 6.229270036s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.........X.............] duration:
1.872606627s
FAIL (2025-08-20 19:26:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.872633508s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.................X..............] duration:
5.770126641s
FAIL (2025-08-20 19:26:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:17:46.972467268 (289h51m41.403547399s) [upload=301431]: Starting upload
Aug 20 19:17:46.972515501 (289h51m41.403595632s) [upload=301431]: Done starting upload
Aug 20 19:17:46.972672722 (289h51m41.403752853s) [upload=301431]: Uploading segments...
Aug 20 19:17:46.972790186 (289h51m41.403870317s) [upload=301431]: Got next segment. Inline: false
Aug 20 19:17:46.972866983 (289h51m41.403947114s) [upload=301431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:17:46.972872474 (289h51m41.403952595s) [upload=301431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:17:47.432147517 (289h51m41.863227638s) [seg_pos={0 0}, upload=301431]: Begin upload segment...
Aug 20 19:17:47.432192893 (289h51m41.863273014s) [seg_pos={0 0}, upload=301431]: Done begin upload segment.
Aug 20 19:17:47.432218292 (289h51m41.863298423s) [noise=true , address=77.90.31.18:4836 , piece_id=E3TXBIJCBDVJTVYOCNCKQOME54L3SDMF4NPJET5LWFERO4BJU7PQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.432414958 (289h51m41.863495089s) [noise=true , address=104.36.82.51:4083 , piece_id=PDCKFPAUPWSRVBCW4OBGURQYA5RIFZIYYIU7G3YBKFR7JWL5L3IQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.432559826 (289h51m41.863639957s) [noise=true , address=45.91.116.10:4089 , piece_id=JLDU6SPMA3ONLLARWQQWJBJO2UQWNNB46Z7VAYND46Z66BSCXZEQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.432837868 (289h51m41.863917999s) [noise=true , address=77.90.31.21:4911 , piece_id=FUBGHZCVRQVDCLU25GANI56PPLH3FS2RGJ22G5BA3JRKUSQGJ5QA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.432968428 (289h51m41.864048559s) [noise=true , address=77.90.31.11:4562 , piece_id=XXHQFNGK6LLJO62SIHYSTZC32MRCUMUI5ZSTJ5IXIKF76WIXYSWA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433092705 (289h51m41.864172836s) [noise=true , address=104.36.82.23:4456 , piece_id=RYYNOZVRTQAWAPCMWTV57Q64SSKAPELJHRQNU6JT4VLTBVDQCHEQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433296324 (289h51m41.864376456s) [noise=true , address=45.91.116.5:4327 , piece_id=CYMBM6LPKHEAPGSUDE45MK6XQ6QPN2CXX2H5QFWGTWTGHXONWHPA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433483763 (289h51m41.864563894s) [noise=true , address=104.36.82.52:4086 , piece_id=YJ55YBLWTDFXO2NRJAANAJMXFI5GTYAKO7GMJP7QZHJRAZPDVIGQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433612219 (289h51m41.86469235s) [noise=true , address=45.91.116.13:4180 , piece_id=Y47F7EWYAGQZTMT7VW5WGUMGGESCXNXF32QQLT2KYHCZMHSSCZQA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.433794218 (289h51m41.864891271s) [noise=true , address=104.36.82.34:4577 , piece_id=THAXTJNZKV4BRRQDDBAKU6K2X7KS7CEKBBSCMDLXS2GUD7SCNDLA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434031882 (289h51m41.865112013s) [noise=true , address=104.36.82.6:4890 , piece_id=MGCKKJND4UE2U5KFTFVABTYXPYYBAAAD2MLTPKHJMWQQSD45TWFQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434123268 (289h51m41.865203399s) [noise=true , address=79.127.205.245:4231 , piece_id=H3TV5VNST3YQ2HN4Q6XD4CPYP26ENSTCQITQCKIGB7P7TGJB4ERA, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434226164 (289h51m41.865306295s) [noise=true , address=104.36.82.37:4678 , piece_id=FFBXYGH6R5AUAEHYFFL2H2KEK65BUAYAC3OJXCYVFKTFBDF3M7DQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434410256 (289h51m41.865490377s) [noise=true , address=104.36.82.18:4388 , piece_id=TMIDS5SSKH46IDFWJSUYHVITVQYGPGODMBRJL2EDUDFQPXO76U5A, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434428141 (289h51m41.865508272s) [noise=true , address=77.90.31.14:4675 , piece_id=G3HCBJTA5H6IGR7J4ZUGLMWTQSF5GJGM4XERCL7CKN7IVOHGFJWQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434675735 (289h51m41.865755866s) [noise=true , address=77.90.31.19:4851 , piece_id=V77JQGYNM374ZVC5OSHWF722JHXGBXAJHKISWPWSD432WVL3RQYQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.434934950 (289h51m41.866015081s) [noise=true , address=104.36.82.60:4343 , piece_id=SRGSF2Q7JQKPAJXIPG6J2YYBCZ7NBWHYIWL6KWBNOOGAWCJ7GV5Q, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:47.435186010 (289h51m41.866266131s) [noise=true , address=104.36.82.50:4014 , piece_id=42C5TT7XNYYPTV4ZTG5POKQ6UAVCIRKYEABFLCJOWW6N56T2E4MQ, seg_pos={0 0}, upload=301431]: Uploading piece...
Aug 20 19:17:48.563697449 (289h51m42.99477758s) [upload=301431]: Next returned nil segment
Aug 20 19:17:48.563715143 (289h51m42.994795274s) [upload=301431]: Waiting for error group managing segments...
Aug 20 19:17:48.856062109 (289h51m43.28714224s) [noise=true , address=79.127.205.245:4231 , piece_id=H3TV5VNST3YQ2HN4Q6XD4CPYP26ENSTCQITQCKIGB7P7TGJB4ERA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.337707166 (289h51m43.768787287s) [noise=true , address=45.91.116.13:4180 , piece_id=Y47F7EWYAGQZTMT7VW5WGUMGGESCXNXF32QQLT2KYHCZMHSSCZQA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.353481046 (289h51m43.784561167s) [noise=true , address=104.36.82.37:4678 , piece_id=FFBXYGH6R5AUAEHYFFL2H2KEK65BUAYAC3OJXCYVFKTFBDF3M7DQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.374078417 (289h51m43.805158548s) [noise=true , address=104.36.82.51:4083 , piece_id=PDCKFPAUPWSRVBCW4OBGURQYA5RIFZIYYIU7G3YBKFR7JWL5L3IQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.402755235 (289h51m43.833835366s) [noise=true , address=77.90.31.21:4911 , piece_id=FUBGHZCVRQVDCLU25GANI56PPLH3FS2RGJ22G5BA3JRKUSQGJ5QA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.420008197 (289h51m43.851088328s) [noise=true , address=104.36.82.52:4086 , piece_id=YJ55YBLWTDFXO2NRJAANAJMXFI5GTYAKO7GMJP7QZHJRAZPDVIGQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.430140934 (289h51m43.861221075s) [noise=true , address=77.90.31.18:4836 , piece_id=E3TXBIJCBDVJTVYOCNCKQOME54L3SDMF4NPJET5LWFERO4BJU7PQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.438203271 (289h51m43.869283402s) [noise=true , address=104.36.82.50:4014 , piece_id=42C5TT7XNYYPTV4ZTG5POKQ6UAVCIRKYEABFLCJOWW6N56T2E4MQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.457487438 (289h51m43.888567569s) [noise=true , address=45.91.116.10:4089 , piece_id=JLDU6SPMA3ONLLARWQQWJBJO2UQWNNB46Z7VAYND46Z66BSCXZEQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.472330969 (289h51m43.9034111s) [noise=true , address=104.36.82.60:4343 , piece_id=SRGSF2Q7JQKPAJXIPG6J2YYBCZ7NBWHYIWL6KWBNOOGAWCJ7GV5Q, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.491775514 (289h51m43.922855645s) [noise=true , address=104.36.82.34:4577 , piece_id=THAXTJNZKV4BRRQDDBAKU6K2X7KS7CEKBBSCMDLXS2GUD7SCNDLA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.492262116 (289h51m43.923342247s) [noise=true , address=104.36.82.6:4890 , piece_id=MGCKKJND4UE2U5KFTFVABTYXPYYBAAAD2MLTPKHJMWQQSD45TWFQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.503727493 (289h51m43.934807614s) [noise=true , address=77.90.31.11:4562 , piece_id=XXHQFNGK6LLJO62SIHYSTZC32MRCUMUI5ZSTJ5IXIKF76WIXYSWA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.526369816 (289h51m43.957449937s) [noise=true , address=77.90.31.14:4675 , piece_id=G3HCBJTA5H6IGR7J4ZUGLMWTQSF5GJGM4XERCL7CKN7IVOHGFJWQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: <nil>
Aug 20 19:17:49.526396057 (289h51m43.957476188s) [seg_pos={0 0}, upload=301431]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:17:49.526584427 (289h51m43.957664558s) [noise=true , address=104.36.82.23:4456 , piece_id=RYYNOZVRTQAWAPCMWTV57Q64SSKAPELJHRQNU6JT4VLTBVDQCHEQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: expected piece hash; context canceled; EOF
Aug 20 19:17:49.526592082 (289h51m43.957672233s) [noise=true , address=104.36.82.18:4388 , piece_id=TMIDS5SSKH46IDFWJSUYHVITVQYGPGODMBRJL2EDUDFQPXO76U5A, seg_pos={0 0}, upload=301431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PSQi81UGvRAmTRKhLyyJw2DmYW44xos3uNgpAbZ6hEa5udKtb): protocol: expected piece hash; context canceled; EOF
Aug 20 19:17:49.526610086 (289h51m43.957690217s) [noise=true , address=45.91.116.5:4327 , piece_id=CYMBM6LPKHEAPGSUDE45MK6XQ6QPN2CXX2H5QFWGTWTGHXONWHPA, seg_pos={0 0}, upload=301431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HY8UAuJNnivgSkxwNfFETRLrFFCtAnGsjkGHVvby1KCycDzSm): protocol: expected piece hash; context canceled; EOF
Aug 20 19:17:49.526677355 (289h51m43.957757576s) [noise=true , address=77.90.31.19:4851 , piece_id=V77JQGYNM374ZVC5OSHWF722JHXGBXAJHKISWPWSD432WVL3RQYQ, seg_pos={0 0}, upload=301431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEV2ndHw4fohVUNsfrzwojd8S11TmMST6Sz59GVnXS8vDGhWk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:17:49.526706320 (289h51m43.957786491s) [seg_pos={0 0}, upload=301431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:17:49.526788337 (289h51m43.957868498s) [upload=301431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:17:49.526795781 (289h51m43.957875932s) [upload=301431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:17:49.900027601 (289h51m44.331107782s) [upload=301431]: Done uploading segments...
Aug 20 19:17:49.900050484 (289h51m44.331130625s) [upload=301431]: Upload finished. err: <nil>
Duration: 5.770150126s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.........X............] duration:
2.001038925s
FAIL (2025-08-20 19:26:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:17:33.971894228 (289h51m28.402974349s) [upload=301425]: Starting upload Aug 20 19:17:33.971945166 (289h51m28.403025287s) [upload=301425]: Done starting upload Aug 20 19:17:33.972025850 (289h51m28.403105981s) [upload=301425]: Uploading segments... Aug 20 19:17:33.972070937 (289h51m28.403151068s) [upload=301425]: Got next segment. Inline: true Aug 20 19:17:33.972074964 (289h51m28.403155095s) [upload=301425]: Waiting for error group managing segments... Aug 20 19:17:33.972150068 (289h51m28.403230199s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:17:33.972154747 (289h51m28.403234868s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:17:33.972157312 (289h51m28.403237443s) [upload=301425]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:17:34.186393675 (289h51m28.617473806s) [upload=301425]: Done uploading segments... Aug 20 19:17:34.186412441 (289h51m28.617492562s) [upload=301425]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.001058662s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|