Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.............X.......XX....X..............X..X..............] duration:
6.012768822s
FAIL (2025-08-16 22:05:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 6.012784173s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X..X........X............................X..X....] duration:
1.867209942s
FAIL (2025-08-16 22:05:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 22:02:02.323450484 (196h35m56.754530615s) [upload=204487]: Starting upload
Aug 16 22:02:02.323502333 (196h35m56.754582464s) [upload=204487]: Done starting upload
Aug 16 22:02:02.323553241 (196h35m56.754633372s) [upload=204487]: Uploading segments...
Aug 16 22:02:02.323591864 (196h35m56.754671996s) [upload=204487]: Got next segment. Inline: true
Aug 16 22:02:02.323596483 (196h35m56.754676614s) [upload=204487]: Waiting for error group managing segments...
Aug 16 22:02:02.323628746 (196h35m56.754708877s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:02:02.323632793 (196h35m56.754712924s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 22:02:02.323637592 (196h35m56.754717723s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:02:02.618704461 (196h35m57.049784582s) [upload=204487]: Done uploading segments...
Aug 16 22:02:02.618724078 (196h35m57.049804199s) [upload=204487]: Upload finished. err: <nil>
Duration: 1.867234249s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X..X........X............................X..X...] duration:
2.003380382s
FAIL (2025-08-16 22:05:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 22:02:02.323450484 (196h35m56.754530615s) [upload=204487]: Starting upload
Aug 16 22:02:02.323502333 (196h35m56.754582464s) [upload=204487]: Done starting upload
Aug 16 22:02:02.323553241 (196h35m56.754633372s) [upload=204487]: Uploading segments...
Aug 16 22:02:02.323591864 (196h35m56.754671996s) [upload=204487]: Got next segment. Inline: true
Aug 16 22:02:02.323596483 (196h35m56.754676614s) [upload=204487]: Waiting for error group managing segments...
Aug 16 22:02:02.323628746 (196h35m56.754708877s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:02:02.323632793 (196h35m56.754712924s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 22:02:02.323637592 (196h35m56.754717723s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:02:02.618704461 (196h35m57.049784582s) [upload=204487]: Done uploading segments...
Aug 16 22:02:02.618724078 (196h35m57.049804199s) [upload=204487]: Upload finished. err: <nil>
Duration: 2.0034105s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..............X.......XX....X..............X..X.............] duration:
6.159176245s
FAIL (2025-08-16 22:04:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 6.159204181s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X..X........X............................X..X..] duration:
2.099919658s
FAIL (2025-08-16 22:04:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 22:02:02.323450484 (196h35m56.754530615s) [upload=204487]: Starting upload
Aug 16 22:02:02.323502333 (196h35m56.754582464s) [upload=204487]: Done starting upload
Aug 16 22:02:02.323553241 (196h35m56.754633372s) [upload=204487]: Uploading segments...
Aug 16 22:02:02.323591864 (196h35m56.754671996s) [upload=204487]: Got next segment. Inline: true
Aug 16 22:02:02.323596483 (196h35m56.754676614s) [upload=204487]: Waiting for error group managing segments...
Aug 16 22:02:02.323628746 (196h35m56.754708877s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:02:02.323632793 (196h35m56.754712924s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 22:02:02.323637592 (196h35m56.754717723s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:02:02.618704461 (196h35m57.049784582s) [upload=204487]: Done uploading segments...
Aug 16 22:02:02.618724078 (196h35m57.049804199s) [upload=204487]: Upload finished. err: <nil>
Duration: 2.099944586s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...............X.......XX....X..............X..X............] duration:
6.555641055s
FAIL (2025-08-16 22:03:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 6.555666115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [................X.......XX....X..............X..X...........] duration:
7.333415595s
FAIL (2025-08-16 22:03:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 7.333443368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............X..X........X............................X..X.] duration:
1.993302498s
FAIL (2025-08-16 22:03:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 22:02:02.323450484 (196h35m56.754530615s) [upload=204487]: Starting upload
Aug 16 22:02:02.323502333 (196h35m56.754582464s) [upload=204487]: Done starting upload
Aug 16 22:02:02.323553241 (196h35m56.754633372s) [upload=204487]: Uploading segments...
Aug 16 22:02:02.323591864 (196h35m56.754671996s) [upload=204487]: Got next segment. Inline: true
Aug 16 22:02:02.323596483 (196h35m56.754676614s) [upload=204487]: Waiting for error group managing segments...
Aug 16 22:02:02.323628746 (196h35m56.754708877s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:02:02.323632793 (196h35m56.754712924s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 22:02:02.323637592 (196h35m56.754717723s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:02:02.618704461 (196h35m57.049784582s) [upload=204487]: Done uploading segments...
Aug 16 22:02:02.618724078 (196h35m57.049804199s) [upload=204487]: Upload finished. err: <nil>
Duration: 1.993328528s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.................X.......XX....X..............X..X..........] duration:
7.222117571s
FAIL (2025-08-16 22:03:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 7.222142046s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..................X.......XX....X..............X..X.........] duration:
6.889888444s
FAIL (2025-08-16 22:02:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 6.889916406s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...................X.......XX....X..............X..X........] duration:
6.481324831s
FAIL (2025-08-16 22:02:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 6.481346995s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...............X..X........X............................X..X] duration:
1.597715737s
FAIL (2025-08-16 22:02:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 16 22:02:02.323450484 (196h35m56.754530615s) [upload=204487]: Starting upload
Aug 16 22:02:02.323502333 (196h35m56.754582464s) [upload=204487]: Done starting upload
Aug 16 22:02:02.323553241 (196h35m56.754633372s) [upload=204487]: Uploading segments...
Aug 16 22:02:02.323591864 (196h35m56.754671996s) [upload=204487]: Got next segment. Inline: true
Aug 16 22:02:02.323596483 (196h35m56.754676614s) [upload=204487]: Waiting for error group managing segments...
Aug 16 22:02:02.323628746 (196h35m56.754708877s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:02:02.323632793 (196h35m56.754712924s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 22:02:02.323637592 (196h35m56.754717723s) [upload=204487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:02:02.618704461 (196h35m57.049784582s) [upload=204487]: Done uploading segments...
Aug 16 22:02:02.618724078 (196h35m57.049804199s) [upload=204487]: Upload finished. err: <nil>
Duration: 1.597740704s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....................X.......XX....X..............X..X.......] duration:
7.015856829s
FAIL (2025-08-16 22:01:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 7.015916142s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X..X........X............................X..] duration:
2.490109054s
FAIL (2025-08-16 22:01:22 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 16 21:59:32.668840275 (196h33m27.099920406s) [upload=204443]: Starting upload Aug 16 21:59:32.668889860 (196h33m27.099969991s) [upload=204443]: Done starting upload Aug 16 21:59:32.668958771 (196h33m27.100038902s) [upload=204443]: Uploading segments... Aug 16 21:59:32.668994158 (196h33m27.10007429s) [upload=204443]: Got next segment. Inline: true Aug 16 21:59:32.668999229 (196h33m27.10007936s) [upload=204443]: Waiting for error group managing segments... Aug 16 21:59:32.669036971 (196h33m27.100117102s) [upload=204443]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:59:32.669041489 (196h33m27.10012162s) [upload=204443]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:59:32.669046168 (196h33m27.100126299s) [upload=204443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:59:32.956831222 (196h33m27.387911353s) [upload=204443]: Done uploading segments... Aug 16 21:59:32.956850208 (196h33m27.38793034s) [upload=204443]: Upload finished. err: <nil>
Duration: 2.490141906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X..X........X............................X.] duration:
2.036694755s
FAIL (2025-08-16 22:00:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 16 21:59:32.668840275 (196h33m27.099920406s) [upload=204443]: Starting upload Aug 16 21:59:32.668889860 (196h33m27.099969991s) [upload=204443]: Done starting upload Aug 16 21:59:32.668958771 (196h33m27.100038902s) [upload=204443]: Uploading segments... Aug 16 21:59:32.668994158 (196h33m27.10007429s) [upload=204443]: Got next segment. Inline: true Aug 16 21:59:32.668999229 (196h33m27.10007936s) [upload=204443]: Waiting for error group managing segments... Aug 16 21:59:32.669036971 (196h33m27.100117102s) [upload=204443]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:59:32.669041489 (196h33m27.10012162s) [upload=204443]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:59:32.669046168 (196h33m27.100126299s) [upload=204443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:59:32.956831222 (196h33m27.387911353s) [upload=204443]: Done uploading segments... Aug 16 21:59:32.956850208 (196h33m27.38793034s) [upload=204443]: Upload finished. err: <nil>
Duration: 2.036716837s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....................X.......XX....X..............X..X......] duration:
7.365921903s
FAIL (2025-08-16 22:00:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 7.365947231s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......................X.......XX....X..............X..X.....] duration:
7.166780519s
FAIL (2025-08-16 21:59:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 7.166810556s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X..X........X............................X] duration:
1.386794288s
FAIL (2025-08-16 21:59:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 16 21:59:32.668840275 (196h33m27.099920406s) [upload=204443]: Starting upload Aug 16 21:59:32.668889860 (196h33m27.099969991s) [upload=204443]: Done starting upload Aug 16 21:59:32.668958771 (196h33m27.100038902s) [upload=204443]: Uploading segments... Aug 16 21:59:32.668994158 (196h33m27.10007429s) [upload=204443]: Got next segment. Inline: true Aug 16 21:59:32.668999229 (196h33m27.10007936s) [upload=204443]: Waiting for error group managing segments... Aug 16 21:59:32.669036971 (196h33m27.100117102s) [upload=204443]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:59:32.669041489 (196h33m27.10012162s) [upload=204443]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:59:32.669046168 (196h33m27.100126299s) [upload=204443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:59:32.956831222 (196h33m27.387911353s) [upload=204443]: Done uploading segments... Aug 16 21:59:32.956850208 (196h33m27.38793034s) [upload=204443]: Upload finished. err: <nil>
Duration: 1.386818104s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......................X.......XX....X..............X..X....] duration:
6.495939054s
FAIL (2025-08-16 21:59:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 6.495966054s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X..X........X............................] duration:
2.107019448s
FAIL (2025-08-16 21:58:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.107043293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........................X.......XX....X..............X..X...] duration:
6.560479508s
FAIL (2025-08-16 21:58:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 6.560501559s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X..X........X...........................] duration:
1.838900213s
FAIL (2025-08-16 21:57:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.838928175s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........................X.......XX....X..............X..X..] duration:
6.93795003s
FAIL (2025-08-16 21:57:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 6.937968416s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X..X........X..........................] duration:
1.939300607s
FAIL (2025-08-16 21:57:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.939324733s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........................X.......XX....X..............X..X.] duration:
7.087011773s
FAIL (2025-08-16 21:56:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 7.087038745s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X..X........X.........................] duration:
1.833946604s
FAIL (2025-08-16 21:56:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833977713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........................X.......XX....X..............X..X] duration:
7.90410253s
FAIL (2025-08-16 21:55:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3411f1ae48367676bb9fa2728e4c03689aae6bd864a5fa4e806dc8db1d333d0c != before 0e011fd2148aece67e602bd0310857301277d20b86232dbc6ab939f82fc24861
======LOGS======
Aug 16 21:55:21.403712289 (196h29m15.83479242s) [upload=204373]: Starting upload
Aug 16 21:55:21.403759618 (196h29m15.83483975s) [upload=204373]: Done starting upload
Aug 16 21:55:21.403847698 (196h29m15.834927829s) [upload=204373]: Uploading segments...
Aug 16 21:55:21.403939673 (196h29m15.835019794s) [upload=204373]: Got next segment. Inline: false
Aug 16 21:55:21.403977866 (196h29m15.835057997s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:55:21.403982897 (196h29m15.835063018s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:55:21.862637671 (196h29m16.293717802s) [seg_pos={0 0}, upload=204373]: Begin upload segment...
Aug 16 21:55:21.862676615 (196h29m16.293756746s) [seg_pos={0 0}, upload=204373]: Done begin upload segment.
Aug 16 21:55:21.862700180 (196h29m16.293780311s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.862809650 (196h29m16.293889781s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863049820 (196h29m16.294129951s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863247468 (196h29m16.294327599s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863311961 (196h29m16.294392092s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863568181 (196h29m16.294648313s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863582027 (196h29m16.294662159s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863848668 (196h29m16.294928789s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.863898363 (196h29m16.294978494s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864185422 (196h29m16.295265543s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864209478 (196h29m16.295299608s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864480938 (196h29m16.295561059s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864577261 (196h29m16.295657382s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864688846 (196h29m16.295768977s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864825758 (196h29m16.295905889s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.864913115 (196h29m16.295993236s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865062640 (196h29m16.296142772s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:21.865302349 (196h29m16.29638247s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Uploading piece...
Aug 16 21:55:23.371233894 (196h29m17.802314025s) [upload=204373]: Next returned nil segment
Aug 16 21:55:23.371252410 (196h29m17.802332541s) [upload=204373]: Waiting for error group managing segments...
Aug 16 21:55:23.781337491 (196h29m18.212417612s) [noise=true , address=104.36.82.60:4356 , piece_id=ZRLEBL5QTI5JKVNYUT534GI4EXSWMJDZ4IP7WD5UV37MXXCVKJSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.785299242 (196h29m18.216379373s) [noise=true , address=79.127.219.51:4203 , piece_id=4K2ZD3SAOCX5SCQ2MOAR64GIEXY2RKVSYWVDQ7TJ4T4BD6SR4R5A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791255940 (196h29m18.222336071s) [noise=true , address=104.36.82.34:4580 , piece_id=LMYEKBAH53QAHN4SD5VXMOYOUSFKETPLVZYRXUGKBBZZWUX6DXIQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.791336163 (196h29m18.222416294s) [noise=true , address=77.90.31.12:4607 , piece_id=TU5DVNHLUL2C4IYKHHKGJMSNMKXXBSEFW73VBUVSXRSITE3TX5XQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.856612993 (196h29m18.287693124s) [noise=true , address=45.91.116.5:4325 , piece_id=RRWFSBT2XXQMOS7JZJUI533NY756E5CTJ3BAW7N77CU5CCJH2NZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:23.999087693 (196h29m18.430167824s) [noise=true , address=77.90.31.10:4538 , piece_id=OYJND7V4RNR3VRSYKMVBCNSM5L5SKDWSUZLVFI3T6TK5U2DHMF5Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.038649009 (196h29m18.46972914s) [noise=true , address=77.90.31.21:4906 , piece_id=UQ6MFO73FXSQ2R76WHJJFWJ4S57MAXXIYR7FI3ZPVR5YXF55KF2Q, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.074567164 (196h29m18.505647285s) [noise=true , address=104.36.82.11:4142 , piece_id=VWLKIOY3XJ3T4K4FG6NON2OUL3MDWOI5UCHPAKRB4FJYDA7U66BA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.101120521 (196h29m18.532200642s) [noise=true , address=45.91.116.6:4988 , piece_id=QI6J4CSGW6DOEM25UGQUWWZMYBT4PRMPJJK2NOKMZEG62Y3HKCXQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.108835893 (196h29m18.539916024s) [noise=true , address=77.90.31.15:4718 , piece_id=IZIRFPG7QB3SEOX6UDC3UDWFXQ4H67IRBNXXVBGSAAK3E2YRS5PQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.114366195 (196h29m18.545446326s) [noise=true , address=104.36.82.61:4403 , piece_id=BLYTYZFEWX5QF7VFXOC5BFMQTVS2YVPTSAU55DPM4RRPEECTEWIA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.231022845 (196h29m18.662102966s) [noise=true , address=104.36.82.16:4320 , piece_id=CDFP7CPWGYMB2JJSBL5EY7GBNVRZSUMQ2NHCM6K7T5IOK26MCGTQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:24.901124601 (196h29m19.332204732s) [noise=true , address=104.36.82.36:4633 , piece_id=2H6XFD6LDUHOGEBMEE6YOVNALMTS2G5OLOU3OX55SH2N5MRZNLLQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134035560 (196h29m19.565115681s) [noise=true , address=104.36.82.17:4336 , piece_id=RBZXI625ZR437X2OVCZ3WY4MP3QEGRFJXFKCBSI2LZG2EC5SIQAA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: <nil>
Aug 16 21:55:25.134068023 (196h29m19.565148154s) [seg_pos={0 0}, upload=204373]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:55:25.134468538 (196h29m19.565548669s) [noise=true , address=104.36.82.37:4654 , piece_id=JDSKL4LBFWLUCRZUAVCZ3AK67HFRUBRZEG7B3PGC7CNZUYL25HSQ, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: rpc: dial tcp 104.36.82.37:4654: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134504508 (196h29m19.565584639s) [noise=true , address=104.36.82.44:4890 , piece_id=DDPTTBJ2COIZ56XCKC5JBWKYB6LUPQICZW76QNECXCM7AVR4NRNA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XYhMcqH63UiHYE4ofxDxjXz2HMvN1RfQjgxxxHcUst7P3aN7M): protocol: rpc: dial tcp 104.36.82.44:4890: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134547179 (196h29m19.56562731s) [noise=true , address=104.36.82.23:4451 , piece_id=LAODCL4QLCXYJ4HDJ4XWURCNQGJ5WRJNLUUYS5LVSXUZDMP5ITZA, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134581795 (196h29m19.565661926s) [noise=true , address=104.36.82.39:4740 , piece_id=E4FB3CEOETRUQ4XNT47WVJI3FZ7T3YSZ2SY2ZZQ62OUW6LCAC23A, seg_pos={0 0}, upload=204373]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A2tCUpDAzrSzhUfBf6GMsZdpY6SPkRHWnqrWiiy7uNGfzcYbq): protocol: read tcp 188.166.225.170:56148->104.36.82.39:4740: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 21:55:25.134610430 (196h29m19.565690591s) [seg_pos={0 0}, upload=204373]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:55:25.134680524 (196h29m19.565760655s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:55:25.134684993 (196h29m19.565765124s) [upload=204373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:55:26.118328936 (196h29m20.549409068s) [upload=204373]: Done uploading segments...
Aug 16 21:55:26.118337804 (196h29m20.549417935s) [upload=204373]: Upload finished. err: <nil>
Duration: 7.904124212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X..X........X........................] duration:
1.936236825s
FAIL (2025-08-16 21:55:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.936261312s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............................X.......XX....X..............X..] duration:
6.405213726s
FAIL (2025-08-16 21:54:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ed7e348dd0de6355f348f5fe57455547778e3b883f4e5cdaea60532cae75f985 != before 898334d8ea5a42ffedf7acc17e5005cee6c5a5507e36fcb2e6f54aa2b9fd02bf
======LOGS======
Aug 16 21:52:36.107007426 (196h26m30.538087557s) [upload=204328]: Starting upload
Aug 16 21:52:36.107066489 (196h26m30.53814662s) [upload=204328]: Done starting upload
Aug 16 21:52:36.107159057 (196h26m30.538239188s) [upload=204328]: Uploading segments...
Aug 16 21:52:36.107336776 (196h26m30.538416907s) [upload=204328]: Got next segment. Inline: false
Aug 16 21:52:36.107365962 (196h26m30.538446093s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:52:36.107370011 (196h26m30.538450142s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:52:36.573686503 (196h26m31.004766635s) [seg_pos={0 0}, upload=204328]: Begin upload segment...
Aug 16 21:52:36.573734095 (196h26m31.004814226s) [seg_pos={0 0}, upload=204328]: Done begin upload segment.
Aug 16 21:52:36.573754955 (196h26m31.004835086s) [noise=true , address=104.36.82.34:4558 , piece_id=Q5VM3YUVRUNNE3D6QV26PNWI73JGBTCVVE6TUDMNY5SO7KOVQ4JQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.573819919 (196h26m31.00490005s) [noise=true , address=64.49.13.170:4717 , piece_id=O5KZEAAMJSMXAWC7HR4XTPGD4BLRQDKSQ5F7ZK3M5XTNSBINJTDA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574118190 (196h26m31.005198321s) [noise=true , address=104.36.82.60:4349 , piece_id=LQHKON4CQ6RS4KFH5LVLNHDPIKPYL5WJKSCFV4ONY2VPPQCS5OUQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574260031 (196h26m31.005340152s) [noise=true , address=104.36.82.59:4321 , piece_id=OAW2GN7Z3OSXG2WIPYVKMJC3EV2GHXNMERRVCQZOXGLFB5AGXI7Q, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574376234 (196h26m31.005456355s) [noise=true , address=77.90.31.19:4875 , piece_id=PATGXLTWOAHPNEOKSLEBBER4JANF36PXTWALWOMSE2E3H3RNZTAA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574599802 (196h26m31.005679933s) [noise=true , address=104.36.82.23:4474 , piece_id=XXCE7QZQOMHUT5H6GR2MJMIVYF45YCS2EVVL6IRIZBOM2UM4SPCQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574663293 (196h26m31.005743424s) [noise=true , address=104.36.82.47:4549 , piece_id=CKIBG7JUKO3NLG2EOBUC3A6TID6HBUCNGKAHMZA6G5LINONULUOQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574946524 (196h26m31.006026656s) [noise=true , address=77.90.31.21:4895 , piece_id=ESDEPHQGGFN7T72QBMPNSM2D6U4O5DN3O7DZ2YQIWCT564KSQ6FA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574969138 (196h26m31.006049259s) [noise=true , address=104.36.82.2:4761 , piece_id=MUXH5ITS5BZYNEAN6CTCQIT47LEBEL2OYDIBMY52ADMN3Z7HG5LA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575208005 (196h26m31.006288126s) [noise=true , address=104.36.82.5:4844 , piece_id=VYQX5A4LFKHB7EQHE2PR2XYIX4O2SRTTOA56TXIOWUZY24NESH3A, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575305050 (196h26m31.006385181s) [noise=true , address=104.36.82.61:4386 , piece_id=EIY37HUAB2IPXGPF4E3DGJU3PSLWUU2ZX4NDHDWRM5MTPAAVTFEA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575456861 (196h26m31.006536982s) [noise=true , address=104.36.82.51:4051 , piece_id=DU62P3GLOOMEWFN6NXBVLTDZB2CBW5RXOZFMAXZUYGPSF4K4QDDA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575576560 (196h26m31.006656691s) [noise=true , address=104.36.82.18:4369 , piece_id=COETPVINZUFBLFCDZXWXOZVTE75HSOWJXVQNCJSPL545CKNYPPTQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575674889 (196h26m31.00675502s) [noise=true , address=45.91.116.12:4246 , piece_id=N7CV2GHVVOZYZ4RSNYJ7H6IZNJ2HQFEXOYB6RMRBDSPOLU6NSU4A, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575811931 (196h26m31.006892062s) [noise=true , address=79.127.220.98:4411 , piece_id=F5Q4HWQKZKTCPILY4ERGWY4WS2FNBTXXZMZLNTA5NC5RZ5LG6LCQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575888868 (196h26m31.006968999s) [noise=true , address=104.36.82.44:4894 , piece_id=VZW2TSM6PBPEZQFE6WQSBSRNDRRGQG5SGEUMGHMYHD7W3SQJT2DA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.576051760 (196h26m31.007131891s) [noise=true , address=45.91.116.14:4220 , piece_id=OXZUC76FJKS3ZIPF7U7IHJGVVBS6OCXOGGXB4AQO5X6YF24PFGGA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.576082208 (196h26m31.007162339s) [noise=true , address=104.36.82.38:4696 , piece_id=472UZJWVKDQJ7OK4RCHPTP5OCXYREYTJE6CLM6VRBLUPTIY3L3SQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:37.738337074 (196h26m32.169417205s) [upload=204328]: Next returned nil segment
Aug 16 21:52:37.738353436 (196h26m32.169433567s) [upload=204328]: Waiting for error group managing segments...
Aug 16 21:52:38.034099413 (196h26m32.465179544s) [noise=true , address=64.49.13.170:4717 , piece_id=O5KZEAAMJSMXAWC7HR4XTPGD4BLRQDKSQ5F7ZK3M5XTNSBINJTDA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.413533918 (196h26m32.84461408s) [noise=true , address=79.127.220.98:4411 , piece_id=F5Q4HWQKZKTCPILY4ERGWY4WS2FNBTXXZMZLNTA5NC5RZ5LG6LCQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.572920818 (196h26m33.004000949s) [noise=true , address=104.36.82.60:4349 , piece_id=LQHKON4CQ6RS4KFH5LVLNHDPIKPYL5WJKSCFV4ONY2VPPQCS5OUQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.610567932 (196h26m33.041648063s) [noise=true , address=104.36.82.51:4051 , piece_id=DU62P3GLOOMEWFN6NXBVLTDZB2CBW5RXOZFMAXZUYGPSF4K4QDDA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.646126950 (196h26m33.077207081s) [noise=true , address=104.36.82.34:4558 , piece_id=Q5VM3YUVRUNNE3D6QV26PNWI73JGBTCVVE6TUDMNY5SO7KOVQ4JQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.685059022 (196h26m33.116139143s) [noise=true , address=77.90.31.21:4895 , piece_id=ESDEPHQGGFN7T72QBMPNSM2D6U4O5DN3O7DZ2YQIWCT564KSQ6FA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.705636325 (196h26m33.136716456s) [noise=true , address=45.91.116.12:4246 , piece_id=N7CV2GHVVOZYZ4RSNYJ7H6IZNJ2HQFEXOYB6RMRBDSPOLU6NSU4A, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.788655863 (196h26m33.219735995s) [noise=true , address=104.36.82.38:4696 , piece_id=472UZJWVKDQJ7OK4RCHPTP5OCXYREYTJE6CLM6VRBLUPTIY3L3SQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.850821821 (196h26m33.281901952s) [noise=true , address=45.91.116.14:4220 , piece_id=OXZUC76FJKS3ZIPF7U7IHJGVVBS6OCXOGGXB4AQO5X6YF24PFGGA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.959938112 (196h26m33.391018234s) [noise=true , address=77.90.31.19:4875 , piece_id=PATGXLTWOAHPNEOKSLEBBER4JANF36PXTWALWOMSE2E3H3RNZTAA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.968694357 (196h26m33.399774488s) [noise=true , address=104.36.82.44:4894 , piece_id=VZW2TSM6PBPEZQFE6WQSBSRNDRRGQG5SGEUMGHMYHD7W3SQJT2DA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.044902853 (196h26m33.475982974s) [noise=true , address=104.36.82.18:4369 , piece_id=COETPVINZUFBLFCDZXWXOZVTE75HSOWJXVQNCJSPL545CKNYPPTQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.166234108 (196h26m33.597314239s) [noise=true , address=104.36.82.61:4386 , piece_id=EIY37HUAB2IPXGPF4E3DGJU3PSLWUU2ZX4NDHDWRM5MTPAAVTFEA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.172847301 (196h26m33.603927432s) [noise=true , address=104.36.82.2:4761 , piece_id=MUXH5ITS5BZYNEAN6CTCQIT47LEBEL2OYDIBMY52ADMN3Z7HG5LA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.172870736 (196h26m33.603950857s) [seg_pos={0 0}, upload=204328]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:52:39.173098923 (196h26m33.604179054s) [noise=true , address=104.36.82.59:4321 , piece_id=OAW2GN7Z3OSXG2WIPYVKMJC3EV2GHXNMERRVCQZOXGLFB5AGXI7Q, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:45166->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:45166->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45166->104.36.82.59:4321: use of closed network connection
Aug 16 21:52:39.173138267 (196h26m33.604218399s) [noise=true , address=104.36.82.23:4474 , piece_id=XXCE7QZQOMHUT5H6GR2MJMIVYF45YCS2EVVL6IRIZBOM2UM4SPCQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 188.166.225.170:51770->104.36.82.23:4474: use of closed network connection; write tcp 188.166.225.170:51770->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51770->104.36.82.23:4474: use of closed network connection
Aug 16 21:52:39.173208803 (196h26m33.604288934s) [noise=true , address=104.36.82.5:4844 , piece_id=VYQX5A4LFKHB7EQHE2PR2XYIX4O2SRTTOA56TXIOWUZY24NESH3A, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: expected piece hash; context canceled; EOF
Aug 16 21:52:39.173264019 (196h26m33.60434415s) [noise=true , address=104.36.82.47:4549 , piece_id=CKIBG7JUKO3NLG2EOBUC3A6TID6HBUCNGKAHMZA6G5LINONULUOQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: write tcp 188.166.225.170:44178->104.36.82.47:4549: use of closed network connection; write tcp 188.166.225.170:44178->104.36.82.47:4549: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44178->104.36.82.47:4549: use of closed network connection
Aug 16 21:52:39.173287053 (196h26m33.604367184s) [seg_pos={0 0}, upload=204328]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:52:39.173360012 (196h26m33.604440143s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:52:39.173364130 (196h26m33.604444271s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:52:39.490958081 (196h26m33.922038212s) [upload=204328]: Done uploading segments...
Aug 16 21:52:39.490976537 (196h26m33.922056668s) [upload=204328]: Upload finished. err: <nil>
Duration: 6.405242643s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X..X........X.......................] duration:
1.84814045s
FAIL (2025-08-16 21:54:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.848167022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X..X........X......................] duration:
2.068654051s
FAIL (2025-08-16 21:53:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.068680091s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............................X.......XX....X..............X.] duration:
6.635304713s
FAIL (2025-08-16 21:53:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ed7e348dd0de6355f348f5fe57455547778e3b883f4e5cdaea60532cae75f985 != before 898334d8ea5a42ffedf7acc17e5005cee6c5a5507e36fcb2e6f54aa2b9fd02bf
======LOGS======
Aug 16 21:52:36.107007426 (196h26m30.538087557s) [upload=204328]: Starting upload
Aug 16 21:52:36.107066489 (196h26m30.53814662s) [upload=204328]: Done starting upload
Aug 16 21:52:36.107159057 (196h26m30.538239188s) [upload=204328]: Uploading segments...
Aug 16 21:52:36.107336776 (196h26m30.538416907s) [upload=204328]: Got next segment. Inline: false
Aug 16 21:52:36.107365962 (196h26m30.538446093s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:52:36.107370011 (196h26m30.538450142s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:52:36.573686503 (196h26m31.004766635s) [seg_pos={0 0}, upload=204328]: Begin upload segment...
Aug 16 21:52:36.573734095 (196h26m31.004814226s) [seg_pos={0 0}, upload=204328]: Done begin upload segment.
Aug 16 21:52:36.573754955 (196h26m31.004835086s) [noise=true , address=104.36.82.34:4558 , piece_id=Q5VM3YUVRUNNE3D6QV26PNWI73JGBTCVVE6TUDMNY5SO7KOVQ4JQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.573819919 (196h26m31.00490005s) [noise=true , address=64.49.13.170:4717 , piece_id=O5KZEAAMJSMXAWC7HR4XTPGD4BLRQDKSQ5F7ZK3M5XTNSBINJTDA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574118190 (196h26m31.005198321s) [noise=true , address=104.36.82.60:4349 , piece_id=LQHKON4CQ6RS4KFH5LVLNHDPIKPYL5WJKSCFV4ONY2VPPQCS5OUQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574260031 (196h26m31.005340152s) [noise=true , address=104.36.82.59:4321 , piece_id=OAW2GN7Z3OSXG2WIPYVKMJC3EV2GHXNMERRVCQZOXGLFB5AGXI7Q, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574376234 (196h26m31.005456355s) [noise=true , address=77.90.31.19:4875 , piece_id=PATGXLTWOAHPNEOKSLEBBER4JANF36PXTWALWOMSE2E3H3RNZTAA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574599802 (196h26m31.005679933s) [noise=true , address=104.36.82.23:4474 , piece_id=XXCE7QZQOMHUT5H6GR2MJMIVYF45YCS2EVVL6IRIZBOM2UM4SPCQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574663293 (196h26m31.005743424s) [noise=true , address=104.36.82.47:4549 , piece_id=CKIBG7JUKO3NLG2EOBUC3A6TID6HBUCNGKAHMZA6G5LINONULUOQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574946524 (196h26m31.006026656s) [noise=true , address=77.90.31.21:4895 , piece_id=ESDEPHQGGFN7T72QBMPNSM2D6U4O5DN3O7DZ2YQIWCT564KSQ6FA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574969138 (196h26m31.006049259s) [noise=true , address=104.36.82.2:4761 , piece_id=MUXH5ITS5BZYNEAN6CTCQIT47LEBEL2OYDIBMY52ADMN3Z7HG5LA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575208005 (196h26m31.006288126s) [noise=true , address=104.36.82.5:4844 , piece_id=VYQX5A4LFKHB7EQHE2PR2XYIX4O2SRTTOA56TXIOWUZY24NESH3A, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575305050 (196h26m31.006385181s) [noise=true , address=104.36.82.61:4386 , piece_id=EIY37HUAB2IPXGPF4E3DGJU3PSLWUU2ZX4NDHDWRM5MTPAAVTFEA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575456861 (196h26m31.006536982s) [noise=true , address=104.36.82.51:4051 , piece_id=DU62P3GLOOMEWFN6NXBVLTDZB2CBW5RXOZFMAXZUYGPSF4K4QDDA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575576560 (196h26m31.006656691s) [noise=true , address=104.36.82.18:4369 , piece_id=COETPVINZUFBLFCDZXWXOZVTE75HSOWJXVQNCJSPL545CKNYPPTQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575674889 (196h26m31.00675502s) [noise=true , address=45.91.116.12:4246 , piece_id=N7CV2GHVVOZYZ4RSNYJ7H6IZNJ2HQFEXOYB6RMRBDSPOLU6NSU4A, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575811931 (196h26m31.006892062s) [noise=true , address=79.127.220.98:4411 , piece_id=F5Q4HWQKZKTCPILY4ERGWY4WS2FNBTXXZMZLNTA5NC5RZ5LG6LCQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575888868 (196h26m31.006968999s) [noise=true , address=104.36.82.44:4894 , piece_id=VZW2TSM6PBPEZQFE6WQSBSRNDRRGQG5SGEUMGHMYHD7W3SQJT2DA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.576051760 (196h26m31.007131891s) [noise=true , address=45.91.116.14:4220 , piece_id=OXZUC76FJKS3ZIPF7U7IHJGVVBS6OCXOGGXB4AQO5X6YF24PFGGA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.576082208 (196h26m31.007162339s) [noise=true , address=104.36.82.38:4696 , piece_id=472UZJWVKDQJ7OK4RCHPTP5OCXYREYTJE6CLM6VRBLUPTIY3L3SQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:37.738337074 (196h26m32.169417205s) [upload=204328]: Next returned nil segment
Aug 16 21:52:37.738353436 (196h26m32.169433567s) [upload=204328]: Waiting for error group managing segments...
Aug 16 21:52:38.034099413 (196h26m32.465179544s) [noise=true , address=64.49.13.170:4717 , piece_id=O5KZEAAMJSMXAWC7HR4XTPGD4BLRQDKSQ5F7ZK3M5XTNSBINJTDA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.413533918 (196h26m32.84461408s) [noise=true , address=79.127.220.98:4411 , piece_id=F5Q4HWQKZKTCPILY4ERGWY4WS2FNBTXXZMZLNTA5NC5RZ5LG6LCQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.572920818 (196h26m33.004000949s) [noise=true , address=104.36.82.60:4349 , piece_id=LQHKON4CQ6RS4KFH5LVLNHDPIKPYL5WJKSCFV4ONY2VPPQCS5OUQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.610567932 (196h26m33.041648063s) [noise=true , address=104.36.82.51:4051 , piece_id=DU62P3GLOOMEWFN6NXBVLTDZB2CBW5RXOZFMAXZUYGPSF4K4QDDA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.646126950 (196h26m33.077207081s) [noise=true , address=104.36.82.34:4558 , piece_id=Q5VM3YUVRUNNE3D6QV26PNWI73JGBTCVVE6TUDMNY5SO7KOVQ4JQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.685059022 (196h26m33.116139143s) [noise=true , address=77.90.31.21:4895 , piece_id=ESDEPHQGGFN7T72QBMPNSM2D6U4O5DN3O7DZ2YQIWCT564KSQ6FA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.705636325 (196h26m33.136716456s) [noise=true , address=45.91.116.12:4246 , piece_id=N7CV2GHVVOZYZ4RSNYJ7H6IZNJ2HQFEXOYB6RMRBDSPOLU6NSU4A, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.788655863 (196h26m33.219735995s) [noise=true , address=104.36.82.38:4696 , piece_id=472UZJWVKDQJ7OK4RCHPTP5OCXYREYTJE6CLM6VRBLUPTIY3L3SQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.850821821 (196h26m33.281901952s) [noise=true , address=45.91.116.14:4220 , piece_id=OXZUC76FJKS3ZIPF7U7IHJGVVBS6OCXOGGXB4AQO5X6YF24PFGGA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.959938112 (196h26m33.391018234s) [noise=true , address=77.90.31.19:4875 , piece_id=PATGXLTWOAHPNEOKSLEBBER4JANF36PXTWALWOMSE2E3H3RNZTAA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.968694357 (196h26m33.399774488s) [noise=true , address=104.36.82.44:4894 , piece_id=VZW2TSM6PBPEZQFE6WQSBSRNDRRGQG5SGEUMGHMYHD7W3SQJT2DA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.044902853 (196h26m33.475982974s) [noise=true , address=104.36.82.18:4369 , piece_id=COETPVINZUFBLFCDZXWXOZVTE75HSOWJXVQNCJSPL545CKNYPPTQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.166234108 (196h26m33.597314239s) [noise=true , address=104.36.82.61:4386 , piece_id=EIY37HUAB2IPXGPF4E3DGJU3PSLWUU2ZX4NDHDWRM5MTPAAVTFEA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.172847301 (196h26m33.603927432s) [noise=true , address=104.36.82.2:4761 , piece_id=MUXH5ITS5BZYNEAN6CTCQIT47LEBEL2OYDIBMY52ADMN3Z7HG5LA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.172870736 (196h26m33.603950857s) [seg_pos={0 0}, upload=204328]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:52:39.173098923 (196h26m33.604179054s) [noise=true , address=104.36.82.59:4321 , piece_id=OAW2GN7Z3OSXG2WIPYVKMJC3EV2GHXNMERRVCQZOXGLFB5AGXI7Q, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:45166->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:45166->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45166->104.36.82.59:4321: use of closed network connection
Aug 16 21:52:39.173138267 (196h26m33.604218399s) [noise=true , address=104.36.82.23:4474 , piece_id=XXCE7QZQOMHUT5H6GR2MJMIVYF45YCS2EVVL6IRIZBOM2UM4SPCQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 188.166.225.170:51770->104.36.82.23:4474: use of closed network connection; write tcp 188.166.225.170:51770->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51770->104.36.82.23:4474: use of closed network connection
Aug 16 21:52:39.173208803 (196h26m33.604288934s) [noise=true , address=104.36.82.5:4844 , piece_id=VYQX5A4LFKHB7EQHE2PR2XYIX4O2SRTTOA56TXIOWUZY24NESH3A, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: expected piece hash; context canceled; EOF
Aug 16 21:52:39.173264019 (196h26m33.60434415s) [noise=true , address=104.36.82.47:4549 , piece_id=CKIBG7JUKO3NLG2EOBUC3A6TID6HBUCNGKAHMZA6G5LINONULUOQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: write tcp 188.166.225.170:44178->104.36.82.47:4549: use of closed network connection; write tcp 188.166.225.170:44178->104.36.82.47:4549: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44178->104.36.82.47:4549: use of closed network connection
Aug 16 21:52:39.173287053 (196h26m33.604367184s) [seg_pos={0 0}, upload=204328]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:52:39.173360012 (196h26m33.604440143s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:52:39.173364130 (196h26m33.604444271s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:52:39.490958081 (196h26m33.922038212s) [upload=204328]: Done uploading segments...
Aug 16 21:52:39.490976537 (196h26m33.922056668s) [upload=204328]: Upload finished. err: <nil>
Duration: 6.635333897s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............................X.......XX....X..............X] duration:
6.550400597s
FAIL (2025-08-16 21:52:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after ed7e348dd0de6355f348f5fe57455547778e3b883f4e5cdaea60532cae75f985 != before 898334d8ea5a42ffedf7acc17e5005cee6c5a5507e36fcb2e6f54aa2b9fd02bf
======LOGS======
Aug 16 21:52:36.107007426 (196h26m30.538087557s) [upload=204328]: Starting upload
Aug 16 21:52:36.107066489 (196h26m30.53814662s) [upload=204328]: Done starting upload
Aug 16 21:52:36.107159057 (196h26m30.538239188s) [upload=204328]: Uploading segments...
Aug 16 21:52:36.107336776 (196h26m30.538416907s) [upload=204328]: Got next segment. Inline: false
Aug 16 21:52:36.107365962 (196h26m30.538446093s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:52:36.107370011 (196h26m30.538450142s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:52:36.573686503 (196h26m31.004766635s) [seg_pos={0 0}, upload=204328]: Begin upload segment...
Aug 16 21:52:36.573734095 (196h26m31.004814226s) [seg_pos={0 0}, upload=204328]: Done begin upload segment.
Aug 16 21:52:36.573754955 (196h26m31.004835086s) [noise=true , address=104.36.82.34:4558 , piece_id=Q5VM3YUVRUNNE3D6QV26PNWI73JGBTCVVE6TUDMNY5SO7KOVQ4JQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.573819919 (196h26m31.00490005s) [noise=true , address=64.49.13.170:4717 , piece_id=O5KZEAAMJSMXAWC7HR4XTPGD4BLRQDKSQ5F7ZK3M5XTNSBINJTDA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574118190 (196h26m31.005198321s) [noise=true , address=104.36.82.60:4349 , piece_id=LQHKON4CQ6RS4KFH5LVLNHDPIKPYL5WJKSCFV4ONY2VPPQCS5OUQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574260031 (196h26m31.005340152s) [noise=true , address=104.36.82.59:4321 , piece_id=OAW2GN7Z3OSXG2WIPYVKMJC3EV2GHXNMERRVCQZOXGLFB5AGXI7Q, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574376234 (196h26m31.005456355s) [noise=true , address=77.90.31.19:4875 , piece_id=PATGXLTWOAHPNEOKSLEBBER4JANF36PXTWALWOMSE2E3H3RNZTAA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574599802 (196h26m31.005679933s) [noise=true , address=104.36.82.23:4474 , piece_id=XXCE7QZQOMHUT5H6GR2MJMIVYF45YCS2EVVL6IRIZBOM2UM4SPCQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574663293 (196h26m31.005743424s) [noise=true , address=104.36.82.47:4549 , piece_id=CKIBG7JUKO3NLG2EOBUC3A6TID6HBUCNGKAHMZA6G5LINONULUOQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574946524 (196h26m31.006026656s) [noise=true , address=77.90.31.21:4895 , piece_id=ESDEPHQGGFN7T72QBMPNSM2D6U4O5DN3O7DZ2YQIWCT564KSQ6FA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.574969138 (196h26m31.006049259s) [noise=true , address=104.36.82.2:4761 , piece_id=MUXH5ITS5BZYNEAN6CTCQIT47LEBEL2OYDIBMY52ADMN3Z7HG5LA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575208005 (196h26m31.006288126s) [noise=true , address=104.36.82.5:4844 , piece_id=VYQX5A4LFKHB7EQHE2PR2XYIX4O2SRTTOA56TXIOWUZY24NESH3A, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575305050 (196h26m31.006385181s) [noise=true , address=104.36.82.61:4386 , piece_id=EIY37HUAB2IPXGPF4E3DGJU3PSLWUU2ZX4NDHDWRM5MTPAAVTFEA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575456861 (196h26m31.006536982s) [noise=true , address=104.36.82.51:4051 , piece_id=DU62P3GLOOMEWFN6NXBVLTDZB2CBW5RXOZFMAXZUYGPSF4K4QDDA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575576560 (196h26m31.006656691s) [noise=true , address=104.36.82.18:4369 , piece_id=COETPVINZUFBLFCDZXWXOZVTE75HSOWJXVQNCJSPL545CKNYPPTQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575674889 (196h26m31.00675502s) [noise=true , address=45.91.116.12:4246 , piece_id=N7CV2GHVVOZYZ4RSNYJ7H6IZNJ2HQFEXOYB6RMRBDSPOLU6NSU4A, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575811931 (196h26m31.006892062s) [noise=true , address=79.127.220.98:4411 , piece_id=F5Q4HWQKZKTCPILY4ERGWY4WS2FNBTXXZMZLNTA5NC5RZ5LG6LCQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.575888868 (196h26m31.006968999s) [noise=true , address=104.36.82.44:4894 , piece_id=VZW2TSM6PBPEZQFE6WQSBSRNDRRGQG5SGEUMGHMYHD7W3SQJT2DA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.576051760 (196h26m31.007131891s) [noise=true , address=45.91.116.14:4220 , piece_id=OXZUC76FJKS3ZIPF7U7IHJGVVBS6OCXOGGXB4AQO5X6YF24PFGGA, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:36.576082208 (196h26m31.007162339s) [noise=true , address=104.36.82.38:4696 , piece_id=472UZJWVKDQJ7OK4RCHPTP5OCXYREYTJE6CLM6VRBLUPTIY3L3SQ, seg_pos={0 0}, upload=204328]: Uploading piece...
Aug 16 21:52:37.738337074 (196h26m32.169417205s) [upload=204328]: Next returned nil segment
Aug 16 21:52:37.738353436 (196h26m32.169433567s) [upload=204328]: Waiting for error group managing segments...
Aug 16 21:52:38.034099413 (196h26m32.465179544s) [noise=true , address=64.49.13.170:4717 , piece_id=O5KZEAAMJSMXAWC7HR4XTPGD4BLRQDKSQ5F7ZK3M5XTNSBINJTDA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.413533918 (196h26m32.84461408s) [noise=true , address=79.127.220.98:4411 , piece_id=F5Q4HWQKZKTCPILY4ERGWY4WS2FNBTXXZMZLNTA5NC5RZ5LG6LCQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.572920818 (196h26m33.004000949s) [noise=true , address=104.36.82.60:4349 , piece_id=LQHKON4CQ6RS4KFH5LVLNHDPIKPYL5WJKSCFV4ONY2VPPQCS5OUQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.610567932 (196h26m33.041648063s) [noise=true , address=104.36.82.51:4051 , piece_id=DU62P3GLOOMEWFN6NXBVLTDZB2CBW5RXOZFMAXZUYGPSF4K4QDDA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.646126950 (196h26m33.077207081s) [noise=true , address=104.36.82.34:4558 , piece_id=Q5VM3YUVRUNNE3D6QV26PNWI73JGBTCVVE6TUDMNY5SO7KOVQ4JQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.685059022 (196h26m33.116139143s) [noise=true , address=77.90.31.21:4895 , piece_id=ESDEPHQGGFN7T72QBMPNSM2D6U4O5DN3O7DZ2YQIWCT564KSQ6FA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.705636325 (196h26m33.136716456s) [noise=true , address=45.91.116.12:4246 , piece_id=N7CV2GHVVOZYZ4RSNYJ7H6IZNJ2HQFEXOYB6RMRBDSPOLU6NSU4A, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.788655863 (196h26m33.219735995s) [noise=true , address=104.36.82.38:4696 , piece_id=472UZJWVKDQJ7OK4RCHPTP5OCXYREYTJE6CLM6VRBLUPTIY3L3SQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.850821821 (196h26m33.281901952s) [noise=true , address=45.91.116.14:4220 , piece_id=OXZUC76FJKS3ZIPF7U7IHJGVVBS6OCXOGGXB4AQO5X6YF24PFGGA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.959938112 (196h26m33.391018234s) [noise=true , address=77.90.31.19:4875 , piece_id=PATGXLTWOAHPNEOKSLEBBER4JANF36PXTWALWOMSE2E3H3RNZTAA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:38.968694357 (196h26m33.399774488s) [noise=true , address=104.36.82.44:4894 , piece_id=VZW2TSM6PBPEZQFE6WQSBSRNDRRGQG5SGEUMGHMYHD7W3SQJT2DA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.044902853 (196h26m33.475982974s) [noise=true , address=104.36.82.18:4369 , piece_id=COETPVINZUFBLFCDZXWXOZVTE75HSOWJXVQNCJSPL545CKNYPPTQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.166234108 (196h26m33.597314239s) [noise=true , address=104.36.82.61:4386 , piece_id=EIY37HUAB2IPXGPF4E3DGJU3PSLWUU2ZX4NDHDWRM5MTPAAVTFEA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.172847301 (196h26m33.603927432s) [noise=true , address=104.36.82.2:4761 , piece_id=MUXH5ITS5BZYNEAN6CTCQIT47LEBEL2OYDIBMY52ADMN3Z7HG5LA, seg_pos={0 0}, upload=204328]: Done uploading piece. err: <nil>
Aug 16 21:52:39.172870736 (196h26m33.603950857s) [seg_pos={0 0}, upload=204328]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:52:39.173098923 (196h26m33.604179054s) [noise=true , address=104.36.82.59:4321 , piece_id=OAW2GN7Z3OSXG2WIPYVKMJC3EV2GHXNMERRVCQZOXGLFB5AGXI7Q, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: write tcp 188.166.225.170:45166->104.36.82.59:4321: use of closed network connection; write tcp 188.166.225.170:45166->104.36.82.59:4321: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45166->104.36.82.59:4321: use of closed network connection
Aug 16 21:52:39.173138267 (196h26m33.604218399s) [noise=true , address=104.36.82.23:4474 , piece_id=XXCE7QZQOMHUT5H6GR2MJMIVYF45YCS2EVVL6IRIZBOM2UM4SPCQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 188.166.225.170:51770->104.36.82.23:4474: use of closed network connection; write tcp 188.166.225.170:51770->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51770->104.36.82.23:4474: use of closed network connection
Aug 16 21:52:39.173208803 (196h26m33.604288934s) [noise=true , address=104.36.82.5:4844 , piece_id=VYQX5A4LFKHB7EQHE2PR2XYIX4O2SRTTOA56TXIOWUZY24NESH3A, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: expected piece hash; context canceled; EOF
Aug 16 21:52:39.173264019 (196h26m33.60434415s) [noise=true , address=104.36.82.47:4549 , piece_id=CKIBG7JUKO3NLG2EOBUC3A6TID6HBUCNGKAHMZA6G5LINONULUOQ, seg_pos={0 0}, upload=204328]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: write tcp 188.166.225.170:44178->104.36.82.47:4549: use of closed network connection; write tcp 188.166.225.170:44178->104.36.82.47:4549: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44178->104.36.82.47:4549: use of closed network connection
Aug 16 21:52:39.173287053 (196h26m33.604367184s) [seg_pos={0 0}, upload=204328]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:52:39.173360012 (196h26m33.604440143s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:52:39.173364130 (196h26m33.604444271s) [upload=204328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:52:39.490958081 (196h26m33.922038212s) [upload=204328]: Done uploading segments...
Aug 16 21:52:39.490976537 (196h26m33.922056668s) [upload=204328]: Upload finished. err: <nil>
Duration: 6.550429352s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................X.......XX....X..............] duration:
8.68477088s
FAIL (2025-08-16 21:52:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 21:40:58.820403875 (196h14m53.251483996s) [upload=204124]: Starting upload
Aug 16 21:40:58.820444372 (196h14m53.251524493s) [upload=204124]: Done starting upload
Aug 16 21:40:58.820621171 (196h14m53.251701302s) [upload=204124]: Uploading segments...
Aug 16 21:40:58.820647572 (196h14m53.251727693s) [upload=204124]: Got next segment. Inline: false
Aug 16 21:40:58.820672850 (196h14m53.251752981s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:40:58.820676948 (196h14m53.251757079s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:40:59.264209467 (196h14m53.695289598s) [seg_pos={0 0}, upload=204124]: Begin upload segment...
Aug 16 21:40:59.264290652 (196h14m53.695370783s) [seg_pos={0 0}, upload=204124]: Done begin upload segment.
Aug 16 21:40:59.264344696 (196h14m53.695424867s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264366487 (196h14m53.695446698s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264443194 (196h14m53.695523325s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265274665 (196h14m53.696354816s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265284484 (196h14m53.696364635s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265890653 (196h14m53.696970784s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265912235 (196h14m53.696992386s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266474580 (196h14m53.697554721s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266480743 (196h14m53.697560894s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266528814 (196h14m53.697608985s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267045313 (196h14m53.698125474s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267093425 (196h14m53.698173576s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267552523 (196h14m53.698632654s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268014607 (196h14m53.699094748s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268497121 (196h14m53.699577262s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268887367 (196h14m53.699967508s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.269264419 (196h14m53.70034455s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.270562252 (196h14m53.701642383s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:41:00.765756677 (196h14m55.196836808s) [upload=204124]: Next returned nil segment
Aug 16 21:41:00.765773969 (196h14m55.1968541s) [upload=204124]: Waiting for error group managing segments...
Aug 16 21:41:01.207631523 (196h14m55.638711684s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.246695077 (196h14m55.677775218s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.258466089 (196h14m55.68954622s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.267367351 (196h14m55.698447502s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.319634979 (196h14m55.75071511s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.385245898 (196h14m55.816326029s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.395197179 (196h14m55.82627731s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.432005879 (196h14m55.86308601s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.490348590 (196h14m55.921428741s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.509128313 (196h14m55.940208444s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.518650623 (196h14m55.949730754s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.558516011 (196h14m55.989596152s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.574414982 (196h14m56.005495113s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627260696 (196h14m56.058340827s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627295613 (196h14m56.058375744s) [seg_pos={0 0}, upload=204124]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:41:01.627489013 (196h14m56.058569154s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627566521 (196h14m56.058646652s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627655902 (196h14m56.058736043s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YGD2pRZaRuK1njBRQsrrrxHoLsK5TjhsckYjc3yTKjTFWHz3V): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627688354 (196h14m56.058768485s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627709344 (196h14m56.058789476s) [seg_pos={0 0}, upload=204124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:41:01.627778127 (196h14m56.058858258s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:41:01.627783998 (196h14m56.058864129s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:41:02.171675241 (196h14m56.602755372s) [upload=204124]: Done uploading segments...
Aug 16 21:41:02.171704547 (196h14m56.602784678s) [upload=204124]: Upload finished. err: <nil>
Duration: 8.684790286s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X..X........X.....................] duration:
1.889459088s
FAIL (2025-08-16 21:52:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.889477033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................X.......XX....X.............] duration:
8.108649704s
FAIL (2025-08-16 21:51:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 21:40:58.820403875 (196h14m53.251483996s) [upload=204124]: Starting upload
Aug 16 21:40:58.820444372 (196h14m53.251524493s) [upload=204124]: Done starting upload
Aug 16 21:40:58.820621171 (196h14m53.251701302s) [upload=204124]: Uploading segments...
Aug 16 21:40:58.820647572 (196h14m53.251727693s) [upload=204124]: Got next segment. Inline: false
Aug 16 21:40:58.820672850 (196h14m53.251752981s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:40:58.820676948 (196h14m53.251757079s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:40:59.264209467 (196h14m53.695289598s) [seg_pos={0 0}, upload=204124]: Begin upload segment...
Aug 16 21:40:59.264290652 (196h14m53.695370783s) [seg_pos={0 0}, upload=204124]: Done begin upload segment.
Aug 16 21:40:59.264344696 (196h14m53.695424867s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264366487 (196h14m53.695446698s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264443194 (196h14m53.695523325s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265274665 (196h14m53.696354816s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265284484 (196h14m53.696364635s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265890653 (196h14m53.696970784s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265912235 (196h14m53.696992386s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266474580 (196h14m53.697554721s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266480743 (196h14m53.697560894s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266528814 (196h14m53.697608985s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267045313 (196h14m53.698125474s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267093425 (196h14m53.698173576s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267552523 (196h14m53.698632654s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268014607 (196h14m53.699094748s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268497121 (196h14m53.699577262s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268887367 (196h14m53.699967508s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.269264419 (196h14m53.70034455s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.270562252 (196h14m53.701642383s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:41:00.765756677 (196h14m55.196836808s) [upload=204124]: Next returned nil segment
Aug 16 21:41:00.765773969 (196h14m55.1968541s) [upload=204124]: Waiting for error group managing segments...
Aug 16 21:41:01.207631523 (196h14m55.638711684s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.246695077 (196h14m55.677775218s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.258466089 (196h14m55.68954622s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.267367351 (196h14m55.698447502s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.319634979 (196h14m55.75071511s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.385245898 (196h14m55.816326029s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.395197179 (196h14m55.82627731s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.432005879 (196h14m55.86308601s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.490348590 (196h14m55.921428741s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.509128313 (196h14m55.940208444s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.518650623 (196h14m55.949730754s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.558516011 (196h14m55.989596152s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.574414982 (196h14m56.005495113s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627260696 (196h14m56.058340827s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627295613 (196h14m56.058375744s) [seg_pos={0 0}, upload=204124]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:41:01.627489013 (196h14m56.058569154s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627566521 (196h14m56.058646652s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627655902 (196h14m56.058736043s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YGD2pRZaRuK1njBRQsrrrxHoLsK5TjhsckYjc3yTKjTFWHz3V): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627688354 (196h14m56.058768485s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627709344 (196h14m56.058789476s) [seg_pos={0 0}, upload=204124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:41:01.627778127 (196h14m56.058858258s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:41:01.627783998 (196h14m56.058864129s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:41:02.171675241 (196h14m56.602755372s) [upload=204124]: Done uploading segments...
Aug 16 21:41:02.171704547 (196h14m56.602784678s) [upload=204124]: Upload finished. err: <nil>
Duration: 8.1086742s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X..X........X....................] duration:
1.90156315s
FAIL (2025-08-16 21:51:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.901590453s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................X..X........X...................] duration:
2.025748326s
FAIL (2025-08-16 21:50:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.025793933s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................................X.......XX....X............] duration:
8.600855711s
FAIL (2025-08-16 21:50:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 21:40:58.820403875 (196h14m53.251483996s) [upload=204124]: Starting upload
Aug 16 21:40:58.820444372 (196h14m53.251524493s) [upload=204124]: Done starting upload
Aug 16 21:40:58.820621171 (196h14m53.251701302s) [upload=204124]: Uploading segments...
Aug 16 21:40:58.820647572 (196h14m53.251727693s) [upload=204124]: Got next segment. Inline: false
Aug 16 21:40:58.820672850 (196h14m53.251752981s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:40:58.820676948 (196h14m53.251757079s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:40:59.264209467 (196h14m53.695289598s) [seg_pos={0 0}, upload=204124]: Begin upload segment...
Aug 16 21:40:59.264290652 (196h14m53.695370783s) [seg_pos={0 0}, upload=204124]: Done begin upload segment.
Aug 16 21:40:59.264344696 (196h14m53.695424867s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264366487 (196h14m53.695446698s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264443194 (196h14m53.695523325s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265274665 (196h14m53.696354816s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265284484 (196h14m53.696364635s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265890653 (196h14m53.696970784s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265912235 (196h14m53.696992386s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266474580 (196h14m53.697554721s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266480743 (196h14m53.697560894s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266528814 (196h14m53.697608985s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267045313 (196h14m53.698125474s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267093425 (196h14m53.698173576s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267552523 (196h14m53.698632654s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268014607 (196h14m53.699094748s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268497121 (196h14m53.699577262s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268887367 (196h14m53.699967508s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.269264419 (196h14m53.70034455s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.270562252 (196h14m53.701642383s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:41:00.765756677 (196h14m55.196836808s) [upload=204124]: Next returned nil segment
Aug 16 21:41:00.765773969 (196h14m55.1968541s) [upload=204124]: Waiting for error group managing segments...
Aug 16 21:41:01.207631523 (196h14m55.638711684s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.246695077 (196h14m55.677775218s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.258466089 (196h14m55.68954622s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.267367351 (196h14m55.698447502s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.319634979 (196h14m55.75071511s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.385245898 (196h14m55.816326029s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.395197179 (196h14m55.82627731s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.432005879 (196h14m55.86308601s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.490348590 (196h14m55.921428741s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.509128313 (196h14m55.940208444s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.518650623 (196h14m55.949730754s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.558516011 (196h14m55.989596152s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.574414982 (196h14m56.005495113s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627260696 (196h14m56.058340827s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627295613 (196h14m56.058375744s) [seg_pos={0 0}, upload=204124]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:41:01.627489013 (196h14m56.058569154s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627566521 (196h14m56.058646652s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627655902 (196h14m56.058736043s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YGD2pRZaRuK1njBRQsrrrxHoLsK5TjhsckYjc3yTKjTFWHz3V): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627688354 (196h14m56.058768485s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627709344 (196h14m56.058789476s) [seg_pos={0 0}, upload=204124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:41:01.627778127 (196h14m56.058858258s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:41:01.627783998 (196h14m56.058864129s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:41:02.171675241 (196h14m56.602755372s) [upload=204124]: Done uploading segments...
Aug 16 21:41:02.171704547 (196h14m56.602784678s) [upload=204124]: Upload finished. err: <nil>
Duration: 8.600884075s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................X..X........X..................] duration:
2.068469179s
FAIL (2025-08-16 21:50:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.068518302s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................................X.......XX....X...........] duration:
7.997303828s
FAIL (2025-08-16 21:49:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 21:40:58.820403875 (196h14m53.251483996s) [upload=204124]: Starting upload
Aug 16 21:40:58.820444372 (196h14m53.251524493s) [upload=204124]: Done starting upload
Aug 16 21:40:58.820621171 (196h14m53.251701302s) [upload=204124]: Uploading segments...
Aug 16 21:40:58.820647572 (196h14m53.251727693s) [upload=204124]: Got next segment. Inline: false
Aug 16 21:40:58.820672850 (196h14m53.251752981s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:40:58.820676948 (196h14m53.251757079s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:40:59.264209467 (196h14m53.695289598s) [seg_pos={0 0}, upload=204124]: Begin upload segment...
Aug 16 21:40:59.264290652 (196h14m53.695370783s) [seg_pos={0 0}, upload=204124]: Done begin upload segment.
Aug 16 21:40:59.264344696 (196h14m53.695424867s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264366487 (196h14m53.695446698s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264443194 (196h14m53.695523325s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265274665 (196h14m53.696354816s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265284484 (196h14m53.696364635s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265890653 (196h14m53.696970784s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265912235 (196h14m53.696992386s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266474580 (196h14m53.697554721s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266480743 (196h14m53.697560894s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266528814 (196h14m53.697608985s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267045313 (196h14m53.698125474s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267093425 (196h14m53.698173576s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267552523 (196h14m53.698632654s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268014607 (196h14m53.699094748s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268497121 (196h14m53.699577262s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268887367 (196h14m53.699967508s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.269264419 (196h14m53.70034455s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.270562252 (196h14m53.701642383s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:41:00.765756677 (196h14m55.196836808s) [upload=204124]: Next returned nil segment
Aug 16 21:41:00.765773969 (196h14m55.1968541s) [upload=204124]: Waiting for error group managing segments...
Aug 16 21:41:01.207631523 (196h14m55.638711684s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.246695077 (196h14m55.677775218s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.258466089 (196h14m55.68954622s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.267367351 (196h14m55.698447502s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.319634979 (196h14m55.75071511s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.385245898 (196h14m55.816326029s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.395197179 (196h14m55.82627731s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.432005879 (196h14m55.86308601s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.490348590 (196h14m55.921428741s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.509128313 (196h14m55.940208444s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.518650623 (196h14m55.949730754s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.558516011 (196h14m55.989596152s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.574414982 (196h14m56.005495113s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627260696 (196h14m56.058340827s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627295613 (196h14m56.058375744s) [seg_pos={0 0}, upload=204124]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:41:01.627489013 (196h14m56.058569154s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627566521 (196h14m56.058646652s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627655902 (196h14m56.058736043s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YGD2pRZaRuK1njBRQsrrrxHoLsK5TjhsckYjc3yTKjTFWHz3V): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627688354 (196h14m56.058768485s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627709344 (196h14m56.058789476s) [seg_pos={0 0}, upload=204124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:41:01.627778127 (196h14m56.058858258s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:41:01.627783998 (196h14m56.058864129s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:41:02.171675241 (196h14m56.602755372s) [upload=204124]: Done uploading segments...
Aug 16 21:41:02.171704547 (196h14m56.602784678s) [upload=204124]: Upload finished. err: <nil>
Duration: 7.997329116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................X..X........X.................] duration:
2.136954777s
FAIL (2025-08-16 21:49:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.136980326s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................................X.......XX....X..........] duration:
6.767772899s
FAIL (2025-08-16 21:48:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 21:40:58.820403875 (196h14m53.251483996s) [upload=204124]: Starting upload
Aug 16 21:40:58.820444372 (196h14m53.251524493s) [upload=204124]: Done starting upload
Aug 16 21:40:58.820621171 (196h14m53.251701302s) [upload=204124]: Uploading segments...
Aug 16 21:40:58.820647572 (196h14m53.251727693s) [upload=204124]: Got next segment. Inline: false
Aug 16 21:40:58.820672850 (196h14m53.251752981s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:40:58.820676948 (196h14m53.251757079s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:40:59.264209467 (196h14m53.695289598s) [seg_pos={0 0}, upload=204124]: Begin upload segment...
Aug 16 21:40:59.264290652 (196h14m53.695370783s) [seg_pos={0 0}, upload=204124]: Done begin upload segment.
Aug 16 21:40:59.264344696 (196h14m53.695424867s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264366487 (196h14m53.695446698s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264443194 (196h14m53.695523325s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265274665 (196h14m53.696354816s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265284484 (196h14m53.696364635s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265890653 (196h14m53.696970784s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265912235 (196h14m53.696992386s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266474580 (196h14m53.697554721s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266480743 (196h14m53.697560894s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266528814 (196h14m53.697608985s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267045313 (196h14m53.698125474s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267093425 (196h14m53.698173576s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267552523 (196h14m53.698632654s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268014607 (196h14m53.699094748s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268497121 (196h14m53.699577262s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268887367 (196h14m53.699967508s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.269264419 (196h14m53.70034455s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.270562252 (196h14m53.701642383s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:41:00.765756677 (196h14m55.196836808s) [upload=204124]: Next returned nil segment
Aug 16 21:41:00.765773969 (196h14m55.1968541s) [upload=204124]: Waiting for error group managing segments...
Aug 16 21:41:01.207631523 (196h14m55.638711684s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.246695077 (196h14m55.677775218s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.258466089 (196h14m55.68954622s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.267367351 (196h14m55.698447502s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.319634979 (196h14m55.75071511s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.385245898 (196h14m55.816326029s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.395197179 (196h14m55.82627731s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.432005879 (196h14m55.86308601s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.490348590 (196h14m55.921428741s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.509128313 (196h14m55.940208444s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.518650623 (196h14m55.949730754s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.558516011 (196h14m55.989596152s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.574414982 (196h14m56.005495113s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627260696 (196h14m56.058340827s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627295613 (196h14m56.058375744s) [seg_pos={0 0}, upload=204124]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:41:01.627489013 (196h14m56.058569154s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627566521 (196h14m56.058646652s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627655902 (196h14m56.058736043s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YGD2pRZaRuK1njBRQsrrrxHoLsK5TjhsckYjc3yTKjTFWHz3V): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627688354 (196h14m56.058768485s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627709344 (196h14m56.058789476s) [seg_pos={0 0}, upload=204124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:41:01.627778127 (196h14m56.058858258s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:41:01.627783998 (196h14m56.058864129s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:41:02.171675241 (196h14m56.602755372s) [upload=204124]: Done uploading segments...
Aug 16 21:41:02.171704547 (196h14m56.602784678s) [upload=204124]: Upload finished. err: <nil>
Duration: 6.76779899s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................X..X........X................] duration:
1.850879334s
FAIL (2025-08-16 21:48:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.850907338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................................X.......XX....X.........] duration:
10.389051275s
FAIL (2025-08-16 21:47:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 21:40:58.820403875 (196h14m53.251483996s) [upload=204124]: Starting upload
Aug 16 21:40:58.820444372 (196h14m53.251524493s) [upload=204124]: Done starting upload
Aug 16 21:40:58.820621171 (196h14m53.251701302s) [upload=204124]: Uploading segments...
Aug 16 21:40:58.820647572 (196h14m53.251727693s) [upload=204124]: Got next segment. Inline: false
Aug 16 21:40:58.820672850 (196h14m53.251752981s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:40:58.820676948 (196h14m53.251757079s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:40:59.264209467 (196h14m53.695289598s) [seg_pos={0 0}, upload=204124]: Begin upload segment...
Aug 16 21:40:59.264290652 (196h14m53.695370783s) [seg_pos={0 0}, upload=204124]: Done begin upload segment.
Aug 16 21:40:59.264344696 (196h14m53.695424867s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264366487 (196h14m53.695446698s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264443194 (196h14m53.695523325s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265274665 (196h14m53.696354816s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265284484 (196h14m53.696364635s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265890653 (196h14m53.696970784s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265912235 (196h14m53.696992386s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266474580 (196h14m53.697554721s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266480743 (196h14m53.697560894s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266528814 (196h14m53.697608985s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267045313 (196h14m53.698125474s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267093425 (196h14m53.698173576s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267552523 (196h14m53.698632654s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268014607 (196h14m53.699094748s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268497121 (196h14m53.699577262s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268887367 (196h14m53.699967508s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.269264419 (196h14m53.70034455s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.270562252 (196h14m53.701642383s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:41:00.765756677 (196h14m55.196836808s) [upload=204124]: Next returned nil segment
Aug 16 21:41:00.765773969 (196h14m55.1968541s) [upload=204124]: Waiting for error group managing segments...
Aug 16 21:41:01.207631523 (196h14m55.638711684s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.246695077 (196h14m55.677775218s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.258466089 (196h14m55.68954622s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.267367351 (196h14m55.698447502s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.319634979 (196h14m55.75071511s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.385245898 (196h14m55.816326029s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.395197179 (196h14m55.82627731s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.432005879 (196h14m55.86308601s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.490348590 (196h14m55.921428741s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.509128313 (196h14m55.940208444s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.518650623 (196h14m55.949730754s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.558516011 (196h14m55.989596152s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.574414982 (196h14m56.005495113s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627260696 (196h14m56.058340827s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627295613 (196h14m56.058375744s) [seg_pos={0 0}, upload=204124]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:41:01.627489013 (196h14m56.058569154s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627566521 (196h14m56.058646652s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627655902 (196h14m56.058736043s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YGD2pRZaRuK1njBRQsrrrxHoLsK5TjhsckYjc3yTKjTFWHz3V): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627688354 (196h14m56.058768485s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627709344 (196h14m56.058789476s) [seg_pos={0 0}, upload=204124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:41:01.627778127 (196h14m56.058858258s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:41:01.627783998 (196h14m56.058864129s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:41:02.171675241 (196h14m56.602755372s) [upload=204124]: Done uploading segments...
Aug 16 21:41:02.171704547 (196h14m56.602784678s) [upload=204124]: Upload finished. err: <nil>
Duration: 10.389077714s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................................X..X........X...............] duration:
1.847397573s
FAIL (2025-08-16 21:47:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.847427761s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................................X.......XX....X........] duration:
7.666270953s
FAIL (2025-08-16 21:47:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 21:40:58.820403875 (196h14m53.251483996s) [upload=204124]: Starting upload
Aug 16 21:40:58.820444372 (196h14m53.251524493s) [upload=204124]: Done starting upload
Aug 16 21:40:58.820621171 (196h14m53.251701302s) [upload=204124]: Uploading segments...
Aug 16 21:40:58.820647572 (196h14m53.251727693s) [upload=204124]: Got next segment. Inline: false
Aug 16 21:40:58.820672850 (196h14m53.251752981s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:40:58.820676948 (196h14m53.251757079s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:40:59.264209467 (196h14m53.695289598s) [seg_pos={0 0}, upload=204124]: Begin upload segment...
Aug 16 21:40:59.264290652 (196h14m53.695370783s) [seg_pos={0 0}, upload=204124]: Done begin upload segment.
Aug 16 21:40:59.264344696 (196h14m53.695424867s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264366487 (196h14m53.695446698s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264443194 (196h14m53.695523325s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265274665 (196h14m53.696354816s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265284484 (196h14m53.696364635s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265890653 (196h14m53.696970784s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265912235 (196h14m53.696992386s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266474580 (196h14m53.697554721s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266480743 (196h14m53.697560894s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266528814 (196h14m53.697608985s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267045313 (196h14m53.698125474s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267093425 (196h14m53.698173576s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267552523 (196h14m53.698632654s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268014607 (196h14m53.699094748s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268497121 (196h14m53.699577262s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268887367 (196h14m53.699967508s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.269264419 (196h14m53.70034455s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.270562252 (196h14m53.701642383s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:41:00.765756677 (196h14m55.196836808s) [upload=204124]: Next returned nil segment
Aug 16 21:41:00.765773969 (196h14m55.1968541s) [upload=204124]: Waiting for error group managing segments...
Aug 16 21:41:01.207631523 (196h14m55.638711684s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.246695077 (196h14m55.677775218s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.258466089 (196h14m55.68954622s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.267367351 (196h14m55.698447502s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.319634979 (196h14m55.75071511s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.385245898 (196h14m55.816326029s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.395197179 (196h14m55.82627731s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.432005879 (196h14m55.86308601s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.490348590 (196h14m55.921428741s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.509128313 (196h14m55.940208444s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.518650623 (196h14m55.949730754s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.558516011 (196h14m55.989596152s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.574414982 (196h14m56.005495113s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627260696 (196h14m56.058340827s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627295613 (196h14m56.058375744s) [seg_pos={0 0}, upload=204124]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:41:01.627489013 (196h14m56.058569154s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627566521 (196h14m56.058646652s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627655902 (196h14m56.058736043s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YGD2pRZaRuK1njBRQsrrrxHoLsK5TjhsckYjc3yTKjTFWHz3V): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627688354 (196h14m56.058768485s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627709344 (196h14m56.058789476s) [seg_pos={0 0}, upload=204124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:41:01.627778127 (196h14m56.058858258s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:41:01.627783998 (196h14m56.058864129s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:41:02.171675241 (196h14m56.602755372s) [upload=204124]: Done uploading segments...
Aug 16 21:41:02.171704547 (196h14m56.602784678s) [upload=204124]: Upload finished. err: <nil>
Duration: 7.666320678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................................X..X........X..............] duration:
1.842517124s
FAIL (2025-08-16 21:47:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.842544595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................................X.......XX....X.......] duration:
6.242916432s
FAIL (2025-08-16 21:46:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 21:40:58.820403875 (196h14m53.251483996s) [upload=204124]: Starting upload
Aug 16 21:40:58.820444372 (196h14m53.251524493s) [upload=204124]: Done starting upload
Aug 16 21:40:58.820621171 (196h14m53.251701302s) [upload=204124]: Uploading segments...
Aug 16 21:40:58.820647572 (196h14m53.251727693s) [upload=204124]: Got next segment. Inline: false
Aug 16 21:40:58.820672850 (196h14m53.251752981s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 21:40:58.820676948 (196h14m53.251757079s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 21:40:59.264209467 (196h14m53.695289598s) [seg_pos={0 0}, upload=204124]: Begin upload segment...
Aug 16 21:40:59.264290652 (196h14m53.695370783s) [seg_pos={0 0}, upload=204124]: Done begin upload segment.
Aug 16 21:40:59.264344696 (196h14m53.695424867s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264366487 (196h14m53.695446698s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.264443194 (196h14m53.695523325s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265274665 (196h14m53.696354816s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265284484 (196h14m53.696364635s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265890653 (196h14m53.696970784s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.265912235 (196h14m53.696992386s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266474580 (196h14m53.697554721s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266480743 (196h14m53.697560894s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.266528814 (196h14m53.697608985s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267045313 (196h14m53.698125474s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267093425 (196h14m53.698173576s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.267552523 (196h14m53.698632654s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268014607 (196h14m53.699094748s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268497121 (196h14m53.699577262s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.268887367 (196h14m53.699967508s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.269264419 (196h14m53.70034455s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:40:59.270562252 (196h14m53.701642383s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Uploading piece...
Aug 16 21:41:00.765756677 (196h14m55.196836808s) [upload=204124]: Next returned nil segment
Aug 16 21:41:00.765773969 (196h14m55.1968541s) [upload=204124]: Waiting for error group managing segments...
Aug 16 21:41:01.207631523 (196h14m55.638711684s) [noise=true , address=104.36.82.60:4354 , piece_id=QMNHNV2QZJAF6XIBW7XXATGU2TSZGSLGR6MXVTLZJYO4YKKEAFQQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.246695077 (196h14m55.677775218s) [noise=true , address=104.36.82.20:4439 , piece_id=NWOE5VSS6DJDPGY7WQWIABX6BG4BLULK3LPPNUFA7653IVA4J4XA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.258466089 (196h14m55.68954622s) [noise=true , address=156.146.43.225:4457 , piece_id=2KSQDNES6Y3T5Q2BHQGVUB7YOXMO5ESFCOGABBV644MB3WCU7SAA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.267367351 (196h14m55.698447502s) [noise=true , address=104.36.82.58:4297 , piece_id=5W3RREECZ42CC5Q4LABPLGYLWLFST3BSEXA2HE2XMGMLSZIIC6SA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.319634979 (196h14m55.75071511s) [noise=true , address=104.36.82.35:4611 , piece_id=IKZ2PB2EBN3ZHWFFGLNNJEVH3WMR3PGPD4HAQINW75DAQK2O573Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.385245898 (196h14m55.816326029s) [noise=true , address=104.36.82.23:4451 , piece_id=JVL4QAPFKESY7BTKRWQ6PSJCGKRBVWZ5YUBDAFXSV3P5PNIQ6SOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.395197179 (196h14m55.82627731s) [noise=true , address=104.36.82.9:4030 , piece_id=HMM7SBETQWOCAOMFNA3RL3MKS3EWYBL3R5XIU5J3DH7QE75LMHWA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.432005879 (196h14m55.86308601s) [noise=true , address=104.36.82.44:4874 , piece_id=N4224ZI42QDTZJG52UD4GDOVUTPVY6BF5OEOB5WM2EG7DF7UACBA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.490348590 (196h14m55.921428741s) [noise=true , address=45.91.116.12:4257 , piece_id=SPFRR4CGDY3YTXKUXGWPP3VAGZY6NJBBD545YPRMWL6RMDKHV47A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.509128313 (196h14m55.940208444s) [noise=true , address=45.91.116.10:4086 , piece_id=DRYXO3QECJMNEYOSK52MHPQYBAOBQG6MVUURSA3A6BYZ4PGUCFXA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.518650623 (196h14m55.949730754s) [noise=true , address=45.91.116.8:4050 , piece_id=EGYX3YJHW5VQ7NJQBRVA5SS7AH63GH5JJMTJB36VUKFFEQW4TA4Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.558516011 (196h14m55.989596152s) [noise=true , address=104.36.82.2:4748 , piece_id=GPB6KEPUWKS4U54SMWPIMGGPCG7M5UE7ZOCMSUPHPNTOYO36ATZQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.574414982 (196h14m56.005495113s) [noise=true , address=77.90.31.14:4674 , piece_id=KPPGKYLPJ4V5U2J5ROSGQWXQC36OGSDHRYY4WHMBCK7TOPB2NM7Q, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627260696 (196h14m56.058340827s) [noise=true , address=77.90.31.10:4522 , piece_id=MKI7XJZAXHXPHESJIXYZM56VJSZPW77E7YQJKTK3SNOCAAQCXFLQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: <nil>
Aug 16 21:41:01.627295613 (196h14m56.058375744s) [seg_pos={0 0}, upload=204124]: Segment reached optimal threshold of 14 pieces.
Aug 16 21:41:01.627489013 (196h14m56.058569154s) [noise=true , address=45.91.116.14:4199 , piece_id=XULVKRHQTCDENJC4DDHYUWHDLU5UCL4U7LTPPVER2RRT2QKIHJ2A, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627566521 (196h14m56.058646652s) [noise=true , address=77.90.31.19:4876 , piece_id=ZTO34JESHQ4BGGH2I3APTDI7DVFVMH4C5L6FFP5OBXVMUULTH5XQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627655902 (196h14m56.058736043s) [noise=true , address=45.91.116.9:4291 , piece_id=BSA7F7L7XQ5QQ7GMK4CYEVO45SFUZOOCN4UVVAXITQXHHAF2QGRA, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YGD2pRZaRuK1njBRQsrrrxHoLsK5TjhsckYjc3yTKjTFWHz3V): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627688354 (196h14m56.058768485s) [noise=true , address=45.91.116.8:4066 , piece_id=II6CNURLV4M7AUHLZBNQPREMURITH3AJVEHPSZZXJ2NOTMQK5GOQ, seg_pos={0 0}, upload=204124]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8): protocol: expected piece hash; context canceled; EOF
Aug 16 21:41:01.627709344 (196h14m56.058789476s) [seg_pos={0 0}, upload=204124]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 21:41:01.627778127 (196h14m56.058858258s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 21:41:01.627783998 (196h14m56.058864129s) [upload=204124]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 21:41:02.171675241 (196h14m56.602755372s) [upload=204124]: Done uploading segments...
Aug 16 21:41:02.171704547 (196h14m56.602784678s) [upload=204124]: Upload finished. err: <nil>
Duration: 6.242933795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................................X..X........X.............] duration:
1.939503176s
FAIL (2025-08-16 21:46:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 21:36:20.232580102 (196h10m14.663660223s) [upload=204040]: Starting upload Aug 16 21:36:20.232646660 (196h10m14.663726791s) [upload=204040]: Done starting upload Aug 16 21:36:20.232701605 (196h10m14.663781736s) [upload=204040]: Uploading segments... Aug 16 21:36:20.232738926 (196h10m14.663819057s) [upload=204040]: Got next segment. Inline: true Aug 16 21:36:20.232742823 (196h10m14.663822944s) [upload=204040]: Waiting for error group managing segments... Aug 16 21:36:20.232776308 (196h10m14.663856439s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 21:36:20.232780386 (196h10m14.663860517s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 21:36:20.232783171 (196h10m14.663863302s) [upload=204040]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 21:36:20.445334142 (196h10m14.876414263s) [upload=204040]: Done uploading segments... Aug 16 21:36:20.445350554 (196h10m14.876430685s) [upload=204040]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.939532181s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|