Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X..............X...X.................] duration:
5.954601737s
FAIL (2025-08-21 01:07:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.954627806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.............X...........XX..................] duration:
2.021491305s
FAIL (2025-08-21 01:07:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.021516893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X..............X...X................] duration:
5.609637501s
FAIL (2025-08-21 01:06:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.609667297s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X.............X...........XX.................] duration:
2.081947079s
FAIL (2025-08-21 01:06:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.081973518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X..............X...X...............] duration:
5.686549032s
FAIL (2025-08-21 01:05:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.686577726s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X..............X...X..............] duration:
5.754187907s
FAIL (2025-08-21 01:05:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.754214378s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X.............X...........XX................] duration:
1.888335077s
FAIL (2025-08-21 01:05:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.888381986s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X..............X...X.............] duration:
5.908226663s
FAIL (2025-08-21 01:04:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.908249145s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X.............X...........XX...............] duration:
1.845630206s
FAIL (2025-08-21 01:04:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.845661075s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...........................X..............X...X............] duration:
6.149550217s
FAIL (2025-08-21 01:04:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 6.149572889s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X.............X...........XX..............] duration:
1.838663495s
FAIL (2025-08-21 01:04:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.838693813s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X...........................X..............X...X...........] duration:
5.813493906s
FAIL (2025-08-21 01:03:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.813534704s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X.............X...........XX.............] duration:
1.952323136s
FAIL (2025-08-21 01:03:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.952349667s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X.............X...........XX............] duration:
2.052430097s
FAIL (2025-08-21 01:02:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.052459533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X...........................X..............X...X..........] duration:
5.763166161s
FAIL (2025-08-21 01:02:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.763185939s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...........................X..............X...X.........] duration:
6.913396615s
FAIL (2025-08-21 01:02:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 6.913429819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.............X...........XX...........] duration:
1.859148991s
FAIL (2025-08-21 01:02:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.859172645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X.............X...........XX..........] duration:
1.990158467s
FAIL (2025-08-21 01:01:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.990180079s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X...........................X..............X...X........] duration:
5.879904615s
FAIL (2025-08-21 01:01:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.879936316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................X.............X...........XX.........] duration:
1.93810352s
FAIL (2025-08-21 01:00:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.938129289s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X...........................X..............X...X.......] duration:
5.689220975s
FAIL (2025-08-21 01:00:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.689246955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................X.............X...........XX........] duration:
1.923528744s
FAIL (2025-08-21 01:00:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.923567479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X...........................X..............X...X......] duration:
5.759954643s
FAIL (2025-08-21 01:00:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.759985692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................X.............X...........XX.......] duration:
1.874034783s
FAIL (2025-08-21 00:59:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.874053769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X...........................X..............X...X.....] duration:
5.943436222s
FAIL (2025-08-21 00:58:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.943462892s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................X.............X...........XX......] duration:
1.824141377s
FAIL (2025-08-21 00:58:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824162778s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........................X.............X...........XX.....] duration:
1.891101517s
FAIL (2025-08-21 00:58:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.891127426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X...........................X.............X...........XX....] duration:
1.885667741s
FAIL (2025-08-21 00:57:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.885695455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X...........................X..............X...X....] duration:
5.603708176s
FAIL (2025-08-21 00:57:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.603735069s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X...........................X..............X...X...] duration:
5.654752936s
FAIL (2025-08-21 00:57:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 5.654776884s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X...........................X.............X...........XX...] duration:
1.870173876s
FAIL (2025-08-21 00:57:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.870210506s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.........X...........................X..............X...X..] duration:
6.04191133s
FAIL (2025-08-21 00:56:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 6.04193697s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X.X...........................X.............X...........XX..] duration:
2.002972707s
FAIL (2025-08-21 00:55:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.003006462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.........X...........................X..............X...X.] duration:
6.52541424s
FAIL (2025-08-21 00:55:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 6.5254403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X.X...........................X.............X...........XX.] duration:
2.014219996s
FAIL (2025-08-21 00:55:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.01425265s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.........X...........................X..............X...X] duration:
6.063569038s
FAIL (2025-08-21 00:54:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c506a993ddc136555fd8b632708e3d34557d6c86a5e920dcadcab92bc6a7e9db != before 713bf37ba9c25d0b5a13e7ebb3016915767f5ba3f90b6bfe76ab2c08a9e4e895
======LOGS======
Aug 21 00:54:39.668677629 (295h28m34.09975776s) [upload=307326]: Starting upload
Aug 21 00:54:39.668728507 (295h28m34.099808638s) [upload=307326]: Done starting upload
Aug 21 00:54:39.668826985 (295h28m34.099907116s) [upload=307326]: Uploading segments...
Aug 21 00:54:39.668900816 (295h28m34.099980987s) [upload=307326]: Got next segment. Inline: false
Aug 21 00:54:39.668937095 (295h28m34.100017226s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:54:39.668942926 (295h28m34.100023057s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:54:40.127599479 (295h28m34.5586796s) [seg_pos={0 0}, upload=307326]: Begin upload segment...
Aug 21 00:54:40.127644946 (295h28m34.558725077s) [seg_pos={0 0}, upload=307326]: Done begin upload segment.
Aug 21 00:54:40.127665234 (295h28m34.558745366s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.127675705 (295h28m34.558755836s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128013261 (295h28m34.559093392s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128016928 (295h28m34.559097059s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128302695 (295h28m34.559382826s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128560909 (295h28m34.55964104s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.128828321 (295h28m34.559908452s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129040437 (295h28m34.560120568s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129254676 (295h28m34.560334807s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129460530 (295h28m34.560540661s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129669680 (295h28m34.560749801s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.129935418 (295h28m34.56101555s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130129119 (295h28m34.56120925s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130311308 (295h28m34.561391439s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130560715 (295h28m34.561640846s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.130810383 (295h28m34.561890514s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131172776 (295h28m34.562252897s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:40.131574815 (295h28m34.562654947s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Uploading piece...
Aug 21 00:54:41.638471012 (295h28m36.069551143s) [upload=307326]: Next returned nil segment
Aug 21 00:54:41.638497833 (295h28m36.069577964s) [upload=307326]: Waiting for error group managing segments...
Aug 21 00:54:42.026867374 (295h28m36.457947505s) [noise=true , address=45.91.116.8:4076 , piece_id=5NZDEKJU523EOSABVJQ6VMN2PMEWDLFRK57PIINAT3QOFO24L7UQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.090489166 (295h28m36.521569297s) [noise=true , address=104.36.82.15:4264 , piece_id=XMBW2YYHDVLPILUEEBWKUCUHVVBS7FWGFA4CEUP6Z776ULXCHZGA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.115238720 (295h28m36.546318851s) [noise=true , address=104.36.82.7:4930 , piece_id=UXT5R427VRLR5S7D65QYQKRU5YCTLOURUGE7W33TTBOGJDRO2EYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.118378988 (295h28m36.549459119s) [noise=true , address=104.36.82.10:4100 , piece_id=6FKFYTKGRXN675PZKJIPBUMHFWZYPDJ3Q4SUMMA7LLCX4DVKNAXA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.126379076 (295h28m36.557459197s) [noise=true , address=77.90.31.16:4742 , piece_id=YCPNAACGAMDRIGFYJUX2BSLG7OQAXVJS7DPTBFZ74X5AZWBXRNYA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.131117062 (295h28m36.562197183s) [noise=true , address=77.90.31.14:4695 , piece_id=567ODXYJBP4F4P446GEH43HWMAFJDEHYPZJCCMPDIN5K3WL4E5LA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.163634899 (295h28m36.594715031s) [noise=true , address=104.36.82.60:4366 , piece_id=O5CI7RGIPZDOIUFZUG62K6TSXI5OZAO5LSL3NZHZFV2LJDHLPAQA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.173611479 (295h28m36.6046916s) [noise=true , address=104.36.82.39:4754 , piece_id=CZWRM7M7IZYVVWL2ZXLMZCRMELJOUOOQVWJBHJKZ5JSE4TZGHILA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.180530567 (295h28m36.611610699s) [noise=true , address=77.90.31.15:4713 , piece_id=D3QSBPNGS4HLWPNIGGJNGZN255QS2G3K6QJUC5E6ZYHEWXAYCVJA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.206818776 (295h28m36.637898897s) [noise=true , address=79.127.201.215:4356 , piece_id=PYR6UIMPSKEDNFUG6BM5YGD27WA6EI27YCZHKJM5HJQSWNCDOPEA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.210511862 (295h28m36.641591993s) [noise=true , address=77.90.31.19:4845 , piece_id=MCFPZNGVPEJF3Q5CDNSSOJNX5PSQNC56HMYYZQWEUGAMJCRFQMDA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.234137978 (295h28m36.665218109s) [noise=true , address=104.36.82.61:4380 , piece_id=2DXNLPYRPRFKHEB6OUU7MNH5FYNQ5EJKFVOSX4F3TZJR6DKFZVOA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.261456318 (295h28m36.692536449s) [noise=true , address=45.91.116.14:4204 , piece_id=C5WRGLIN66ZK4ODYXU7EOUNIQH7TGRIDHEQUUXK6BJGDWSPRES3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284394686 (295h28m36.715474817s) [noise=true , address=104.36.82.40:4976 , piece_id=6YO3DO7FD6WTPVBVXYE2RES4TVPNU35XONT3GZL7M6CYOX4PYU3A, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284413883 (295h28m36.715494014s) [seg_pos={0 0}, upload=307326]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:54:42.284630037 (295h28m36.715710168s) [noise=true , address=45.91.116.7:4019 , piece_id=HC4T7RY265QYJG6VYRCAPTV3M62YDOYMEX4AI3NY5DVB2E56A4MQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm): protocol: expected piece hash; context canceled; EOF
Aug 21 00:54:42.284743213 (295h28m36.715823334s) [noise=true , address=104.36.82.5:4868 , piece_id=UFIDWTE2T5ZJOAKLGTBRBIWKTKDONYMQZRL5QCIUAAZDOKP4PLDQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41128->104.36.82.5:4868: use of closed network connection
Aug 21 00:54:42.284785093 (295h28m36.715865224s) [noise=true , address=77.90.31.11:4567 , piece_id=3L43AC55LEAMFL2Z23AVK4UXYX7TQGP4WUY3SINYVGCUVRVA6VTQ, seg_pos={0 0}, upload=307326]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56352->77.90.31.11:4567: use of closed network connection
Aug 21 00:54:42.284890795 (295h28m36.715970937s) [noise=true , address=104.36.82.23:4460 , piece_id=IJEXM6ZZVCZ7QUCII47BIHKUNH2A4CM67OSDKPUSYJDBLGCASWZA, seg_pos={0 0}, upload=307326]: Done uploading piece. err: <nil>
Aug 21 00:54:42.284968063 (295h28m36.716048215s) [seg_pos={0 0}, upload=307326]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 00:54:42.285063406 (295h28m36.716143537s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:54:42.285068997 (295h28m36.716149138s) [upload=307326]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:54:42.704467868 (295h28m37.135547989s) [upload=307326]: Done uploading segments...
Aug 21 00:54:42.704487676 (295h28m37.135567807s) [upload=307326]: Upload finished. err: <nil>
Duration: 6.0635915s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X..X.........X...........................X..............X...] duration:
5.887304881s
FAIL (2025-08-21 00:54:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64ac6e550b27b05211e6180f1cd4b1bfd681f53b8d38a011a8c14b0d9c06247f != before 0573f1a32bb9e5086084c975bc235931586e6a722a9f626ce9f1d6a5c20f5c96
======LOGS======
Aug 21 00:51:49.876456305 (295h25m44.307536436s) [upload=307274]: Starting upload
Aug 21 00:51:49.876507884 (295h25m44.307588015s) [upload=307274]: Done starting upload
Aug 21 00:51:49.876609890 (295h25m44.307690021s) [upload=307274]: Uploading segments...
Aug 21 00:51:49.876676266 (295h25m44.307756397s) [upload=307274]: Got next segment. Inline: false
Aug 21 00:51:49.876704560 (295h25m44.307784691s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:51:49.876708669 (295h25m44.3077888s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:51:50.359887954 (295h25m44.790968075s) [seg_pos={0 0}, upload=307274]: Begin upload segment...
Aug 21 00:51:50.359936777 (295h25m44.791016908s) [seg_pos={0 0}, upload=307274]: Done begin upload segment.
Aug 21 00:51:50.359958689 (295h25m44.79103881s) [noise=true , address=77.90.31.19:4868 , piece_id=Z2VH74TPVOXYBVKCMKRAQVMYYLQAPZHNBWGPQX7ABDZMIFGBMG7Q, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360016019 (295h25m44.79109615s) [noise=true , address=104.36.82.19:4408 , piece_id=RB3MY3SU7ZAP5E5VCBSLA7QXCO43ZSDTHHKYP6HK6DFGBBJGB57Q, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360365367 (295h25m44.791445488s) [noise=true , address=77.90.31.17:4790 , piece_id=24O5FEJHWPCEGQLKAWLKM3PIJXRARVCEEGVFWPZ47KSUB6FQ5UZQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360373212 (295h25m44.791453343s) [noise=true , address=104.36.82.2:4759 , piece_id=YFIDE4FZHONK7DPQKJBX6YW67X2F5T6WYY5UHFM4MZ5Y5MEDSEOA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360604515 (295h25m44.791684636s) [noise=true , address=104.36.82.51:4061 , piece_id=DTGUCSHD75CK7CHKQBHFZS3T2XX4SDHFBLWYO5NQZO7T5ALTXCIQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360736488 (295h25m44.791816619s) [noise=true , address=45.91.116.4:4964 , piece_id=OY5SETCRH7IMPZIKYDE5C6SMMHEINLU5XOGTPM3PSLEFMLOOT3AA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360824306 (295h25m44.791904437s) [noise=true , address=45.91.116.12:4250 , piece_id=IA6E7ASUS4NZNSHZTD2HQ4INVE3V3C6RFDPPMJHTUJMRYRU4FYQA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361016483 (295h25m44.792096604s) [noise=true , address=77.90.31.10:4530 , piece_id=JGEUKAWZS6GBWKREGALOYQMKK63CWLZXCEZ4FZEYDEXPYJB72BNA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361044958 (295h25m44.792125089s) [noise=true , address=45.91.116.9:4273 , piece_id=IJAN6RY2XANRXDMVSTZNHS5T7XTJGKBAMOV6DKEXDBFJ6XH3X4YA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361270810 (295h25m44.792350941s) [noise=true , address=77.90.31.18:4818 , piece_id=SIKSPPIIRKQ7Q5MZ573UZU77EOPQKCOXEUUIY3ELM6YPQGVHZHTA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361304965 (295h25m44.792385096s) [noise=true , address=104.36.82.11:4125 , piece_id=MVT6NCX37J7B44WKXUQW2Y7ULQ2DYKUWQFJQN6TIRIEJV5LMRXCA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361556105 (295h25m44.792636236s) [noise=true , address=45.91.116.12:4231 , piece_id=3JOSWWDFCMJTHKJDCIKK2PB7K2KSY2RXJPUCNPMX6RLXH4VMK2JA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361570974 (295h25m44.792651095s) [noise=true , address=104.36.82.36:4640 , piece_id=4FWBKXJZXZSMGLRGUGDZIA5V67JGFO3FU3NLEBX2XOJNSPA2NTJA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361793350 (295h25m44.792873481s) [noise=true , address=104.36.82.45:4915 , piece_id=UOSESRO4UQCOCBZKSI7HCG4VVJGMJFUJZD4K7JCNSH7CC4JCD2DQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361827475 (295h25m44.792907606s) [noise=true , address=104.36.82.4:4827 , piece_id=CWPQ6H5AZWL2JO6O2PK3E3C5ZAZRZ2GZSMCM6SQCBCSYYG6Y3IOQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362013501 (295h25m44.793093632s) [noise=true , address=77.90.31.11:4574 , piece_id=33LZXW7GYFSGEZMWUEFZR4KMFO24YNVPXVIKKMNQQLJA22MT6LWQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362047035 (295h25m44.793127166s) [noise=true , address=104.36.82.60:4356 , piece_id=IFNZB6TWMUY5PXT7MJTILKGPFCKJYMS54ZF3SHD22T4JCKDGWIQQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362302394 (295h25m44.793382525s) [noise=true , address=77.90.31.19:4858 , piece_id=J7DVXR7BC6B3IVENTD7JNX7JHU2JRR3DBRLAHBH56N7ZGPPAIUHQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:51.844877122 (295h25m46.275957253s) [upload=307274]: Next returned nil segment
Aug 21 00:51:51.844893433 (295h25m46.275973564s) [upload=307274]: Waiting for error group managing segments...
Aug 21 00:51:52.276732617 (295h25m46.707812748s) [noise=true , address=104.36.82.4:4827 , piece_id=CWPQ6H5AZWL2JO6O2PK3E3C5ZAZRZ2GZSMCM6SQCBCSYYG6Y3IOQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.285958419 (295h25m46.71703855s) [noise=true , address=45.91.116.12:4250 , piece_id=IA6E7ASUS4NZNSHZTD2HQ4INVE3V3C6RFDPPMJHTUJMRYRU4FYQA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.302350103 (295h25m46.733430264s) [noise=true , address=45.91.116.9:4273 , piece_id=IJAN6RY2XANRXDMVSTZNHS5T7XTJGKBAMOV6DKEXDBFJ6XH3X4YA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.318157457 (295h25m46.749237588s) [noise=true , address=104.36.82.51:4061 , piece_id=DTGUCSHD75CK7CHKQBHFZS3T2XX4SDHFBLWYO5NQZO7T5ALTXCIQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.346747822 (295h25m46.777827953s) [noise=true , address=45.91.116.12:4231 , piece_id=3JOSWWDFCMJTHKJDCIKK2PB7K2KSY2RXJPUCNPMX6RLXH4VMK2JA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.350586577 (295h25m46.781666708s) [noise=true , address=77.90.31.19:4868 , piece_id=Z2VH74TPVOXYBVKCMKRAQVMYYLQAPZHNBWGPQX7ABDZMIFGBMG7Q, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.355288573 (295h25m46.786368694s) [noise=true , address=77.90.31.19:4858 , piece_id=J7DVXR7BC6B3IVENTD7JNX7JHU2JRR3DBRLAHBH56N7ZGPPAIUHQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.363292256 (295h25m46.794372387s) [noise=true , address=45.91.116.4:4964 , piece_id=OY5SETCRH7IMPZIKYDE5C6SMMHEINLU5XOGTPM3PSLEFMLOOT3AA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.371977305 (295h25m46.803057436s) [noise=true , address=104.36.82.19:4408 , piece_id=RB3MY3SU7ZAP5E5VCBSLA7QXCO43ZSDTHHKYP6HK6DFGBBJGB57Q, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.375839363 (295h25m46.806919494s) [noise=true , address=77.90.31.17:4790 , piece_id=24O5FEJHWPCEGQLKAWLKM3PIJXRARVCEEGVFWPZ47KSUB6FQ5UZQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.376353808 (295h25m46.807433939s) [noise=true , address=77.90.31.18:4818 , piece_id=SIKSPPIIRKQ7Q5MZ573UZU77EOPQKCOXEUUIY3ELM6YPQGVHZHTA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.408874452 (295h25m46.839954583s) [noise=true , address=77.90.31.10:4530 , piece_id=JGEUKAWZS6GBWKREGALOYQMKK63CWLZXCEZ4FZEYDEXPYJB72BNA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.411266509 (295h25m46.84234663s) [noise=true , address=104.36.82.2:4759 , piece_id=YFIDE4FZHONK7DPQKJBX6YW67X2F5T6WYY5UHFM4MZ5Y5MEDSEOA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.422109285 (295h25m46.853189416s) [noise=true , address=104.36.82.36:4640 , piece_id=4FWBKXJZXZSMGLRGUGDZIA5V67JGFO3FU3NLEBX2XOJNSPA2NTJA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.422122150 (295h25m46.853202281s) [seg_pos={0 0}, upload=307274]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:51:52.422225908 (295h25m46.853306039s) [noise=true , address=104.36.82.60:4356 , piece_id=IFNZB6TWMUY5PXT7MJTILKGPFCKJYMS54ZF3SHD22T4JCKDGWIQQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422276805 (295h25m46.853356936s) [noise=true , address=77.90.31.11:4574 , piece_id=33LZXW7GYFSGEZMWUEFZR4KMFO24YNVPXVIKKMNQQLJA22MT6LWQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422343223 (295h25m46.853423354s) [noise=true , address=104.36.82.11:4125 , piece_id=MVT6NCX37J7B44WKXUQW2Y7ULQ2DYKUWQFJQN6TIRIEJV5LMRXCA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422424619 (295h25m46.85350475s) [noise=true , address=104.36.82.45:4915 , piece_id=UOSESRO4UQCOCBZKSI7HCG4VVJGMJFUJZD4K7JCNSH7CC4JCD2DQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422486076 (295h25m46.853566207s) [seg_pos={0 0}, upload=307274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 00:51:52.422567061 (295h25m46.853647192s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:51:52.422571630 (295h25m46.853651761s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:51:52.902698294 (295h25m47.333778425s) [upload=307274]: Done uploading segments...
Aug 21 00:51:52.902719595 (295h25m47.333799726s) [upload=307274]: Upload finished. err: <nil>
Duration: 5.887331933s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X.X...........................X.............X...........XX] duration:
865.442272ms
FAIL (2025-08-21 00:54:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:54:00.334495721 (295h27m54.765575852s) [upload=307311]: Starting upload Aug 21 00:54:00.334537791 (295h27m54.765617912s) [upload=307311]: Done starting upload Aug 21 00:54:00.334585252 (295h27m54.765665383s) [upload=307311]: Uploading segments... Aug 21 00:54:00.334617694 (295h27m54.765697825s) [upload=307311]: Got next segment. Inline: true Aug 21 00:54:00.334621060 (295h27m54.765701181s) [upload=307311]: Waiting for error group managing segments... Aug 21 00:54:00.334651628 (295h27m54.765731759s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:54:00.334657279 (295h27m54.76573741s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:54:00.334660085 (295h27m54.765740216s) [upload=307311]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:54:00.549493278 (295h27m54.980573409s) [upload=307311]: Done uploading segments... Aug 21 00:54:00.549511463 (295h27m54.980591584s) [upload=307311]: Upload finished. err: metaclient: Too Many Requests
Duration: 865.468853ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X..X.........X...........................X..............X..] duration:
5.948758604s
FAIL (2025-08-21 00:53:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64ac6e550b27b05211e6180f1cd4b1bfd681f53b8d38a011a8c14b0d9c06247f != before 0573f1a32bb9e5086084c975bc235931586e6a722a9f626ce9f1d6a5c20f5c96
======LOGS======
Aug 21 00:51:49.876456305 (295h25m44.307536436s) [upload=307274]: Starting upload
Aug 21 00:51:49.876507884 (295h25m44.307588015s) [upload=307274]: Done starting upload
Aug 21 00:51:49.876609890 (295h25m44.307690021s) [upload=307274]: Uploading segments...
Aug 21 00:51:49.876676266 (295h25m44.307756397s) [upload=307274]: Got next segment. Inline: false
Aug 21 00:51:49.876704560 (295h25m44.307784691s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:51:49.876708669 (295h25m44.3077888s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:51:50.359887954 (295h25m44.790968075s) [seg_pos={0 0}, upload=307274]: Begin upload segment...
Aug 21 00:51:50.359936777 (295h25m44.791016908s) [seg_pos={0 0}, upload=307274]: Done begin upload segment.
Aug 21 00:51:50.359958689 (295h25m44.79103881s) [noise=true , address=77.90.31.19:4868 , piece_id=Z2VH74TPVOXYBVKCMKRAQVMYYLQAPZHNBWGPQX7ABDZMIFGBMG7Q, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360016019 (295h25m44.79109615s) [noise=true , address=104.36.82.19:4408 , piece_id=RB3MY3SU7ZAP5E5VCBSLA7QXCO43ZSDTHHKYP6HK6DFGBBJGB57Q, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360365367 (295h25m44.791445488s) [noise=true , address=77.90.31.17:4790 , piece_id=24O5FEJHWPCEGQLKAWLKM3PIJXRARVCEEGVFWPZ47KSUB6FQ5UZQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360373212 (295h25m44.791453343s) [noise=true , address=104.36.82.2:4759 , piece_id=YFIDE4FZHONK7DPQKJBX6YW67X2F5T6WYY5UHFM4MZ5Y5MEDSEOA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360604515 (295h25m44.791684636s) [noise=true , address=104.36.82.51:4061 , piece_id=DTGUCSHD75CK7CHKQBHFZS3T2XX4SDHFBLWYO5NQZO7T5ALTXCIQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360736488 (295h25m44.791816619s) [noise=true , address=45.91.116.4:4964 , piece_id=OY5SETCRH7IMPZIKYDE5C6SMMHEINLU5XOGTPM3PSLEFMLOOT3AA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360824306 (295h25m44.791904437s) [noise=true , address=45.91.116.12:4250 , piece_id=IA6E7ASUS4NZNSHZTD2HQ4INVE3V3C6RFDPPMJHTUJMRYRU4FYQA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361016483 (295h25m44.792096604s) [noise=true , address=77.90.31.10:4530 , piece_id=JGEUKAWZS6GBWKREGALOYQMKK63CWLZXCEZ4FZEYDEXPYJB72BNA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361044958 (295h25m44.792125089s) [noise=true , address=45.91.116.9:4273 , piece_id=IJAN6RY2XANRXDMVSTZNHS5T7XTJGKBAMOV6DKEXDBFJ6XH3X4YA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361270810 (295h25m44.792350941s) [noise=true , address=77.90.31.18:4818 , piece_id=SIKSPPIIRKQ7Q5MZ573UZU77EOPQKCOXEUUIY3ELM6YPQGVHZHTA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361304965 (295h25m44.792385096s) [noise=true , address=104.36.82.11:4125 , piece_id=MVT6NCX37J7B44WKXUQW2Y7ULQ2DYKUWQFJQN6TIRIEJV5LMRXCA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361556105 (295h25m44.792636236s) [noise=true , address=45.91.116.12:4231 , piece_id=3JOSWWDFCMJTHKJDCIKK2PB7K2KSY2RXJPUCNPMX6RLXH4VMK2JA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361570974 (295h25m44.792651095s) [noise=true , address=104.36.82.36:4640 , piece_id=4FWBKXJZXZSMGLRGUGDZIA5V67JGFO3FU3NLEBX2XOJNSPA2NTJA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361793350 (295h25m44.792873481s) [noise=true , address=104.36.82.45:4915 , piece_id=UOSESRO4UQCOCBZKSI7HCG4VVJGMJFUJZD4K7JCNSH7CC4JCD2DQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361827475 (295h25m44.792907606s) [noise=true , address=104.36.82.4:4827 , piece_id=CWPQ6H5AZWL2JO6O2PK3E3C5ZAZRZ2GZSMCM6SQCBCSYYG6Y3IOQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362013501 (295h25m44.793093632s) [noise=true , address=77.90.31.11:4574 , piece_id=33LZXW7GYFSGEZMWUEFZR4KMFO24YNVPXVIKKMNQQLJA22MT6LWQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362047035 (295h25m44.793127166s) [noise=true , address=104.36.82.60:4356 , piece_id=IFNZB6TWMUY5PXT7MJTILKGPFCKJYMS54ZF3SHD22T4JCKDGWIQQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362302394 (295h25m44.793382525s) [noise=true , address=77.90.31.19:4858 , piece_id=J7DVXR7BC6B3IVENTD7JNX7JHU2JRR3DBRLAHBH56N7ZGPPAIUHQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:51.844877122 (295h25m46.275957253s) [upload=307274]: Next returned nil segment
Aug 21 00:51:51.844893433 (295h25m46.275973564s) [upload=307274]: Waiting for error group managing segments...
Aug 21 00:51:52.276732617 (295h25m46.707812748s) [noise=true , address=104.36.82.4:4827 , piece_id=CWPQ6H5AZWL2JO6O2PK3E3C5ZAZRZ2GZSMCM6SQCBCSYYG6Y3IOQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.285958419 (295h25m46.71703855s) [noise=true , address=45.91.116.12:4250 , piece_id=IA6E7ASUS4NZNSHZTD2HQ4INVE3V3C6RFDPPMJHTUJMRYRU4FYQA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.302350103 (295h25m46.733430264s) [noise=true , address=45.91.116.9:4273 , piece_id=IJAN6RY2XANRXDMVSTZNHS5T7XTJGKBAMOV6DKEXDBFJ6XH3X4YA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.318157457 (295h25m46.749237588s) [noise=true , address=104.36.82.51:4061 , piece_id=DTGUCSHD75CK7CHKQBHFZS3T2XX4SDHFBLWYO5NQZO7T5ALTXCIQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.346747822 (295h25m46.777827953s) [noise=true , address=45.91.116.12:4231 , piece_id=3JOSWWDFCMJTHKJDCIKK2PB7K2KSY2RXJPUCNPMX6RLXH4VMK2JA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.350586577 (295h25m46.781666708s) [noise=true , address=77.90.31.19:4868 , piece_id=Z2VH74TPVOXYBVKCMKRAQVMYYLQAPZHNBWGPQX7ABDZMIFGBMG7Q, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.355288573 (295h25m46.786368694s) [noise=true , address=77.90.31.19:4858 , piece_id=J7DVXR7BC6B3IVENTD7JNX7JHU2JRR3DBRLAHBH56N7ZGPPAIUHQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.363292256 (295h25m46.794372387s) [noise=true , address=45.91.116.4:4964 , piece_id=OY5SETCRH7IMPZIKYDE5C6SMMHEINLU5XOGTPM3PSLEFMLOOT3AA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.371977305 (295h25m46.803057436s) [noise=true , address=104.36.82.19:4408 , piece_id=RB3MY3SU7ZAP5E5VCBSLA7QXCO43ZSDTHHKYP6HK6DFGBBJGB57Q, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.375839363 (295h25m46.806919494s) [noise=true , address=77.90.31.17:4790 , piece_id=24O5FEJHWPCEGQLKAWLKM3PIJXRARVCEEGVFWPZ47KSUB6FQ5UZQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.376353808 (295h25m46.807433939s) [noise=true , address=77.90.31.18:4818 , piece_id=SIKSPPIIRKQ7Q5MZ573UZU77EOPQKCOXEUUIY3ELM6YPQGVHZHTA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.408874452 (295h25m46.839954583s) [noise=true , address=77.90.31.10:4530 , piece_id=JGEUKAWZS6GBWKREGALOYQMKK63CWLZXCEZ4FZEYDEXPYJB72BNA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.411266509 (295h25m46.84234663s) [noise=true , address=104.36.82.2:4759 , piece_id=YFIDE4FZHONK7DPQKJBX6YW67X2F5T6WYY5UHFM4MZ5Y5MEDSEOA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.422109285 (295h25m46.853189416s) [noise=true , address=104.36.82.36:4640 , piece_id=4FWBKXJZXZSMGLRGUGDZIA5V67JGFO3FU3NLEBX2XOJNSPA2NTJA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.422122150 (295h25m46.853202281s) [seg_pos={0 0}, upload=307274]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:51:52.422225908 (295h25m46.853306039s) [noise=true , address=104.36.82.60:4356 , piece_id=IFNZB6TWMUY5PXT7MJTILKGPFCKJYMS54ZF3SHD22T4JCKDGWIQQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422276805 (295h25m46.853356936s) [noise=true , address=77.90.31.11:4574 , piece_id=33LZXW7GYFSGEZMWUEFZR4KMFO24YNVPXVIKKMNQQLJA22MT6LWQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422343223 (295h25m46.853423354s) [noise=true , address=104.36.82.11:4125 , piece_id=MVT6NCX37J7B44WKXUQW2Y7ULQ2DYKUWQFJQN6TIRIEJV5LMRXCA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422424619 (295h25m46.85350475s) [noise=true , address=104.36.82.45:4915 , piece_id=UOSESRO4UQCOCBZKSI7HCG4VVJGMJFUJZD4K7JCNSH7CC4JCD2DQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422486076 (295h25m46.853566207s) [seg_pos={0 0}, upload=307274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 00:51:52.422567061 (295h25m46.853647192s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:51:52.422571630 (295h25m46.853651761s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:51:52.902698294 (295h25m47.333778425s) [upload=307274]: Done uploading segments...
Aug 21 00:51:52.902719595 (295h25m47.333799726s) [upload=307274]: Upload finished. err: <nil>
Duration: 5.948783713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X.X...........................X.............X...........X] duration:
2.29686048s
FAIL (2025-08-21 00:53:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 00:53:34.199433080 (295h27m28.630513211s) [upload=307301]: Starting upload
Aug 21 00:53:34.199490800 (295h27m28.630570921s) [upload=307301]: Done starting upload
Aug 21 00:53:34.199551928 (295h27m28.630632059s) [upload=307301]: Uploading segments...
Aug 21 00:53:34.199590552 (295h27m28.630670683s) [upload=307301]: Got next segment. Inline: true
Aug 21 00:53:34.199595992 (295h27m28.630676123s) [upload=307301]: Waiting for error group managing segments...
Aug 21 00:53:34.199629806 (295h27m28.630709937s) [upload=307301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:53:34.199633685 (295h27m28.630713816s) [upload=307301]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 00:53:34.199636259 (295h27m28.63071639s) [upload=307301]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:53:35.131876880 (295h27m29.562957001s) [upload=307301]: Done uploading segments...
Aug 21 00:53:35.131896678 (295h27m29.562976809s) [upload=307301]: Upload finished. err: <nil>
Duration: 2.296880378s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X..X.........X...........................X..............X.] duration:
5.93710329s
FAIL (2025-08-21 00:52:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64ac6e550b27b05211e6180f1cd4b1bfd681f53b8d38a011a8c14b0d9c06247f != before 0573f1a32bb9e5086084c975bc235931586e6a722a9f626ce9f1d6a5c20f5c96
======LOGS======
Aug 21 00:51:49.876456305 (295h25m44.307536436s) [upload=307274]: Starting upload
Aug 21 00:51:49.876507884 (295h25m44.307588015s) [upload=307274]: Done starting upload
Aug 21 00:51:49.876609890 (295h25m44.307690021s) [upload=307274]: Uploading segments...
Aug 21 00:51:49.876676266 (295h25m44.307756397s) [upload=307274]: Got next segment. Inline: false
Aug 21 00:51:49.876704560 (295h25m44.307784691s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:51:49.876708669 (295h25m44.3077888s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:51:50.359887954 (295h25m44.790968075s) [seg_pos={0 0}, upload=307274]: Begin upload segment...
Aug 21 00:51:50.359936777 (295h25m44.791016908s) [seg_pos={0 0}, upload=307274]: Done begin upload segment.
Aug 21 00:51:50.359958689 (295h25m44.79103881s) [noise=true , address=77.90.31.19:4868 , piece_id=Z2VH74TPVOXYBVKCMKRAQVMYYLQAPZHNBWGPQX7ABDZMIFGBMG7Q, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360016019 (295h25m44.79109615s) [noise=true , address=104.36.82.19:4408 , piece_id=RB3MY3SU7ZAP5E5VCBSLA7QXCO43ZSDTHHKYP6HK6DFGBBJGB57Q, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360365367 (295h25m44.791445488s) [noise=true , address=77.90.31.17:4790 , piece_id=24O5FEJHWPCEGQLKAWLKM3PIJXRARVCEEGVFWPZ47KSUB6FQ5UZQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360373212 (295h25m44.791453343s) [noise=true , address=104.36.82.2:4759 , piece_id=YFIDE4FZHONK7DPQKJBX6YW67X2F5T6WYY5UHFM4MZ5Y5MEDSEOA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360604515 (295h25m44.791684636s) [noise=true , address=104.36.82.51:4061 , piece_id=DTGUCSHD75CK7CHKQBHFZS3T2XX4SDHFBLWYO5NQZO7T5ALTXCIQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360736488 (295h25m44.791816619s) [noise=true , address=45.91.116.4:4964 , piece_id=OY5SETCRH7IMPZIKYDE5C6SMMHEINLU5XOGTPM3PSLEFMLOOT3AA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360824306 (295h25m44.791904437s) [noise=true , address=45.91.116.12:4250 , piece_id=IA6E7ASUS4NZNSHZTD2HQ4INVE3V3C6RFDPPMJHTUJMRYRU4FYQA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361016483 (295h25m44.792096604s) [noise=true , address=77.90.31.10:4530 , piece_id=JGEUKAWZS6GBWKREGALOYQMKK63CWLZXCEZ4FZEYDEXPYJB72BNA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361044958 (295h25m44.792125089s) [noise=true , address=45.91.116.9:4273 , piece_id=IJAN6RY2XANRXDMVSTZNHS5T7XTJGKBAMOV6DKEXDBFJ6XH3X4YA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361270810 (295h25m44.792350941s) [noise=true , address=77.90.31.18:4818 , piece_id=SIKSPPIIRKQ7Q5MZ573UZU77EOPQKCOXEUUIY3ELM6YPQGVHZHTA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361304965 (295h25m44.792385096s) [noise=true , address=104.36.82.11:4125 , piece_id=MVT6NCX37J7B44WKXUQW2Y7ULQ2DYKUWQFJQN6TIRIEJV5LMRXCA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361556105 (295h25m44.792636236s) [noise=true , address=45.91.116.12:4231 , piece_id=3JOSWWDFCMJTHKJDCIKK2PB7K2KSY2RXJPUCNPMX6RLXH4VMK2JA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361570974 (295h25m44.792651095s) [noise=true , address=104.36.82.36:4640 , piece_id=4FWBKXJZXZSMGLRGUGDZIA5V67JGFO3FU3NLEBX2XOJNSPA2NTJA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361793350 (295h25m44.792873481s) [noise=true , address=104.36.82.45:4915 , piece_id=UOSESRO4UQCOCBZKSI7HCG4VVJGMJFUJZD4K7JCNSH7CC4JCD2DQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361827475 (295h25m44.792907606s) [noise=true , address=104.36.82.4:4827 , piece_id=CWPQ6H5AZWL2JO6O2PK3E3C5ZAZRZ2GZSMCM6SQCBCSYYG6Y3IOQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362013501 (295h25m44.793093632s) [noise=true , address=77.90.31.11:4574 , piece_id=33LZXW7GYFSGEZMWUEFZR4KMFO24YNVPXVIKKMNQQLJA22MT6LWQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362047035 (295h25m44.793127166s) [noise=true , address=104.36.82.60:4356 , piece_id=IFNZB6TWMUY5PXT7MJTILKGPFCKJYMS54ZF3SHD22T4JCKDGWIQQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362302394 (295h25m44.793382525s) [noise=true , address=77.90.31.19:4858 , piece_id=J7DVXR7BC6B3IVENTD7JNX7JHU2JRR3DBRLAHBH56N7ZGPPAIUHQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:51.844877122 (295h25m46.275957253s) [upload=307274]: Next returned nil segment
Aug 21 00:51:51.844893433 (295h25m46.275973564s) [upload=307274]: Waiting for error group managing segments...
Aug 21 00:51:52.276732617 (295h25m46.707812748s) [noise=true , address=104.36.82.4:4827 , piece_id=CWPQ6H5AZWL2JO6O2PK3E3C5ZAZRZ2GZSMCM6SQCBCSYYG6Y3IOQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.285958419 (295h25m46.71703855s) [noise=true , address=45.91.116.12:4250 , piece_id=IA6E7ASUS4NZNSHZTD2HQ4INVE3V3C6RFDPPMJHTUJMRYRU4FYQA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.302350103 (295h25m46.733430264s) [noise=true , address=45.91.116.9:4273 , piece_id=IJAN6RY2XANRXDMVSTZNHS5T7XTJGKBAMOV6DKEXDBFJ6XH3X4YA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.318157457 (295h25m46.749237588s) [noise=true , address=104.36.82.51:4061 , piece_id=DTGUCSHD75CK7CHKQBHFZS3T2XX4SDHFBLWYO5NQZO7T5ALTXCIQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.346747822 (295h25m46.777827953s) [noise=true , address=45.91.116.12:4231 , piece_id=3JOSWWDFCMJTHKJDCIKK2PB7K2KSY2RXJPUCNPMX6RLXH4VMK2JA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.350586577 (295h25m46.781666708s) [noise=true , address=77.90.31.19:4868 , piece_id=Z2VH74TPVOXYBVKCMKRAQVMYYLQAPZHNBWGPQX7ABDZMIFGBMG7Q, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.355288573 (295h25m46.786368694s) [noise=true , address=77.90.31.19:4858 , piece_id=J7DVXR7BC6B3IVENTD7JNX7JHU2JRR3DBRLAHBH56N7ZGPPAIUHQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.363292256 (295h25m46.794372387s) [noise=true , address=45.91.116.4:4964 , piece_id=OY5SETCRH7IMPZIKYDE5C6SMMHEINLU5XOGTPM3PSLEFMLOOT3AA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.371977305 (295h25m46.803057436s) [noise=true , address=104.36.82.19:4408 , piece_id=RB3MY3SU7ZAP5E5VCBSLA7QXCO43ZSDTHHKYP6HK6DFGBBJGB57Q, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.375839363 (295h25m46.806919494s) [noise=true , address=77.90.31.17:4790 , piece_id=24O5FEJHWPCEGQLKAWLKM3PIJXRARVCEEGVFWPZ47KSUB6FQ5UZQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.376353808 (295h25m46.807433939s) [noise=true , address=77.90.31.18:4818 , piece_id=SIKSPPIIRKQ7Q5MZ573UZU77EOPQKCOXEUUIY3ELM6YPQGVHZHTA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.408874452 (295h25m46.839954583s) [noise=true , address=77.90.31.10:4530 , piece_id=JGEUKAWZS6GBWKREGALOYQMKK63CWLZXCEZ4FZEYDEXPYJB72BNA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.411266509 (295h25m46.84234663s) [noise=true , address=104.36.82.2:4759 , piece_id=YFIDE4FZHONK7DPQKJBX6YW67X2F5T6WYY5UHFM4MZ5Y5MEDSEOA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.422109285 (295h25m46.853189416s) [noise=true , address=104.36.82.36:4640 , piece_id=4FWBKXJZXZSMGLRGUGDZIA5V67JGFO3FU3NLEBX2XOJNSPA2NTJA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.422122150 (295h25m46.853202281s) [seg_pos={0 0}, upload=307274]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:51:52.422225908 (295h25m46.853306039s) [noise=true , address=104.36.82.60:4356 , piece_id=IFNZB6TWMUY5PXT7MJTILKGPFCKJYMS54ZF3SHD22T4JCKDGWIQQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422276805 (295h25m46.853356936s) [noise=true , address=77.90.31.11:4574 , piece_id=33LZXW7GYFSGEZMWUEFZR4KMFO24YNVPXVIKKMNQQLJA22MT6LWQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422343223 (295h25m46.853423354s) [noise=true , address=104.36.82.11:4125 , piece_id=MVT6NCX37J7B44WKXUQW2Y7ULQ2DYKUWQFJQN6TIRIEJV5LMRXCA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422424619 (295h25m46.85350475s) [noise=true , address=104.36.82.45:4915 , piece_id=UOSESRO4UQCOCBZKSI7HCG4VVJGMJFUJZD4K7JCNSH7CC4JCD2DQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422486076 (295h25m46.853566207s) [seg_pos={0 0}, upload=307274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 00:51:52.422567061 (295h25m46.853647192s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:51:52.422571630 (295h25m46.853651761s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:51:52.902698294 (295h25m47.333778425s) [upload=307274]: Done uploading segments...
Aug 21 00:51:52.902719595 (295h25m47.333799726s) [upload=307274]: Upload finished. err: <nil>
Duration: 5.937137026s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X.X...........................X.............X...........] duration:
1.876385501s
FAIL (2025-08-21 00:52:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0bc378b04b03cf4203616e6183d40ce6e8323b77acbbb9fc75b3a72429ab045b != before 6a515a53294b909c1192fd19202d72d7cfdf98c47daec6a21abdbfb2f52e3b27 ======LOGS====== Aug 21 00:46:04.695402642 (295h19m59.126482773s) [upload=307170]: Starting upload Aug 21 00:46:04.695462408 (295h19m59.126542539s) [upload=307170]: Done starting upload Aug 21 00:46:04.695529485 (295h19m59.126609617s) [upload=307170]: Uploading segments... Aug 21 00:46:04.695577798 (295h19m59.126657929s) [upload=307170]: Got next segment. Inline: true Aug 21 00:46:04.695582798 (295h19m59.126662929s) [upload=307170]: Waiting for error group managing segments... Aug 21 00:46:04.695650927 (295h19m59.126731068s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:46:04.695656569 (295h19m59.1267367s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:46:04.695662510 (295h19m59.126742631s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:46:05.032709432 (295h19m59.463789563s) [upload=307170]: Done uploading segments... Aug 21 00:46:05.032716816 (295h19m59.463796947s) [upload=307170]: Upload finished. err: <nil>
Duration: 1.876428433s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X..X.........X...........................X..............X] duration:
6.083900321s
FAIL (2025-08-21 00:51:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64ac6e550b27b05211e6180f1cd4b1bfd681f53b8d38a011a8c14b0d9c06247f != before 0573f1a32bb9e5086084c975bc235931586e6a722a9f626ce9f1d6a5c20f5c96
======LOGS======
Aug 21 00:51:49.876456305 (295h25m44.307536436s) [upload=307274]: Starting upload
Aug 21 00:51:49.876507884 (295h25m44.307588015s) [upload=307274]: Done starting upload
Aug 21 00:51:49.876609890 (295h25m44.307690021s) [upload=307274]: Uploading segments...
Aug 21 00:51:49.876676266 (295h25m44.307756397s) [upload=307274]: Got next segment. Inline: false
Aug 21 00:51:49.876704560 (295h25m44.307784691s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 00:51:49.876708669 (295h25m44.3077888s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 00:51:50.359887954 (295h25m44.790968075s) [seg_pos={0 0}, upload=307274]: Begin upload segment...
Aug 21 00:51:50.359936777 (295h25m44.791016908s) [seg_pos={0 0}, upload=307274]: Done begin upload segment.
Aug 21 00:51:50.359958689 (295h25m44.79103881s) [noise=true , address=77.90.31.19:4868 , piece_id=Z2VH74TPVOXYBVKCMKRAQVMYYLQAPZHNBWGPQX7ABDZMIFGBMG7Q, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360016019 (295h25m44.79109615s) [noise=true , address=104.36.82.19:4408 , piece_id=RB3MY3SU7ZAP5E5VCBSLA7QXCO43ZSDTHHKYP6HK6DFGBBJGB57Q, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360365367 (295h25m44.791445488s) [noise=true , address=77.90.31.17:4790 , piece_id=24O5FEJHWPCEGQLKAWLKM3PIJXRARVCEEGVFWPZ47KSUB6FQ5UZQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360373212 (295h25m44.791453343s) [noise=true , address=104.36.82.2:4759 , piece_id=YFIDE4FZHONK7DPQKJBX6YW67X2F5T6WYY5UHFM4MZ5Y5MEDSEOA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360604515 (295h25m44.791684636s) [noise=true , address=104.36.82.51:4061 , piece_id=DTGUCSHD75CK7CHKQBHFZS3T2XX4SDHFBLWYO5NQZO7T5ALTXCIQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360736488 (295h25m44.791816619s) [noise=true , address=45.91.116.4:4964 , piece_id=OY5SETCRH7IMPZIKYDE5C6SMMHEINLU5XOGTPM3PSLEFMLOOT3AA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.360824306 (295h25m44.791904437s) [noise=true , address=45.91.116.12:4250 , piece_id=IA6E7ASUS4NZNSHZTD2HQ4INVE3V3C6RFDPPMJHTUJMRYRU4FYQA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361016483 (295h25m44.792096604s) [noise=true , address=77.90.31.10:4530 , piece_id=JGEUKAWZS6GBWKREGALOYQMKK63CWLZXCEZ4FZEYDEXPYJB72BNA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361044958 (295h25m44.792125089s) [noise=true , address=45.91.116.9:4273 , piece_id=IJAN6RY2XANRXDMVSTZNHS5T7XTJGKBAMOV6DKEXDBFJ6XH3X4YA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361270810 (295h25m44.792350941s) [noise=true , address=77.90.31.18:4818 , piece_id=SIKSPPIIRKQ7Q5MZ573UZU77EOPQKCOXEUUIY3ELM6YPQGVHZHTA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361304965 (295h25m44.792385096s) [noise=true , address=104.36.82.11:4125 , piece_id=MVT6NCX37J7B44WKXUQW2Y7ULQ2DYKUWQFJQN6TIRIEJV5LMRXCA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361556105 (295h25m44.792636236s) [noise=true , address=45.91.116.12:4231 , piece_id=3JOSWWDFCMJTHKJDCIKK2PB7K2KSY2RXJPUCNPMX6RLXH4VMK2JA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361570974 (295h25m44.792651095s) [noise=true , address=104.36.82.36:4640 , piece_id=4FWBKXJZXZSMGLRGUGDZIA5V67JGFO3FU3NLEBX2XOJNSPA2NTJA, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361793350 (295h25m44.792873481s) [noise=true , address=104.36.82.45:4915 , piece_id=UOSESRO4UQCOCBZKSI7HCG4VVJGMJFUJZD4K7JCNSH7CC4JCD2DQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.361827475 (295h25m44.792907606s) [noise=true , address=104.36.82.4:4827 , piece_id=CWPQ6H5AZWL2JO6O2PK3E3C5ZAZRZ2GZSMCM6SQCBCSYYG6Y3IOQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362013501 (295h25m44.793093632s) [noise=true , address=77.90.31.11:4574 , piece_id=33LZXW7GYFSGEZMWUEFZR4KMFO24YNVPXVIKKMNQQLJA22MT6LWQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362047035 (295h25m44.793127166s) [noise=true , address=104.36.82.60:4356 , piece_id=IFNZB6TWMUY5PXT7MJTILKGPFCKJYMS54ZF3SHD22T4JCKDGWIQQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:50.362302394 (295h25m44.793382525s) [noise=true , address=77.90.31.19:4858 , piece_id=J7DVXR7BC6B3IVENTD7JNX7JHU2JRR3DBRLAHBH56N7ZGPPAIUHQ, seg_pos={0 0}, upload=307274]: Uploading piece...
Aug 21 00:51:51.844877122 (295h25m46.275957253s) [upload=307274]: Next returned nil segment
Aug 21 00:51:51.844893433 (295h25m46.275973564s) [upload=307274]: Waiting for error group managing segments...
Aug 21 00:51:52.276732617 (295h25m46.707812748s) [noise=true , address=104.36.82.4:4827 , piece_id=CWPQ6H5AZWL2JO6O2PK3E3C5ZAZRZ2GZSMCM6SQCBCSYYG6Y3IOQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.285958419 (295h25m46.71703855s) [noise=true , address=45.91.116.12:4250 , piece_id=IA6E7ASUS4NZNSHZTD2HQ4INVE3V3C6RFDPPMJHTUJMRYRU4FYQA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.302350103 (295h25m46.733430264s) [noise=true , address=45.91.116.9:4273 , piece_id=IJAN6RY2XANRXDMVSTZNHS5T7XTJGKBAMOV6DKEXDBFJ6XH3X4YA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.318157457 (295h25m46.749237588s) [noise=true , address=104.36.82.51:4061 , piece_id=DTGUCSHD75CK7CHKQBHFZS3T2XX4SDHFBLWYO5NQZO7T5ALTXCIQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.346747822 (295h25m46.777827953s) [noise=true , address=45.91.116.12:4231 , piece_id=3JOSWWDFCMJTHKJDCIKK2PB7K2KSY2RXJPUCNPMX6RLXH4VMK2JA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.350586577 (295h25m46.781666708s) [noise=true , address=77.90.31.19:4868 , piece_id=Z2VH74TPVOXYBVKCMKRAQVMYYLQAPZHNBWGPQX7ABDZMIFGBMG7Q, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.355288573 (295h25m46.786368694s) [noise=true , address=77.90.31.19:4858 , piece_id=J7DVXR7BC6B3IVENTD7JNX7JHU2JRR3DBRLAHBH56N7ZGPPAIUHQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.363292256 (295h25m46.794372387s) [noise=true , address=45.91.116.4:4964 , piece_id=OY5SETCRH7IMPZIKYDE5C6SMMHEINLU5XOGTPM3PSLEFMLOOT3AA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.371977305 (295h25m46.803057436s) [noise=true , address=104.36.82.19:4408 , piece_id=RB3MY3SU7ZAP5E5VCBSLA7QXCO43ZSDTHHKYP6HK6DFGBBJGB57Q, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.375839363 (295h25m46.806919494s) [noise=true , address=77.90.31.17:4790 , piece_id=24O5FEJHWPCEGQLKAWLKM3PIJXRARVCEEGVFWPZ47KSUB6FQ5UZQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.376353808 (295h25m46.807433939s) [noise=true , address=77.90.31.18:4818 , piece_id=SIKSPPIIRKQ7Q5MZ573UZU77EOPQKCOXEUUIY3ELM6YPQGVHZHTA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.408874452 (295h25m46.839954583s) [noise=true , address=77.90.31.10:4530 , piece_id=JGEUKAWZS6GBWKREGALOYQMKK63CWLZXCEZ4FZEYDEXPYJB72BNA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.411266509 (295h25m46.84234663s) [noise=true , address=104.36.82.2:4759 , piece_id=YFIDE4FZHONK7DPQKJBX6YW67X2F5T6WYY5UHFM4MZ5Y5MEDSEOA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.422109285 (295h25m46.853189416s) [noise=true , address=104.36.82.36:4640 , piece_id=4FWBKXJZXZSMGLRGUGDZIA5V67JGFO3FU3NLEBX2XOJNSPA2NTJA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: <nil>
Aug 21 00:51:52.422122150 (295h25m46.853202281s) [seg_pos={0 0}, upload=307274]: Segment reached optimal threshold of 14 pieces.
Aug 21 00:51:52.422225908 (295h25m46.853306039s) [noise=true , address=104.36.82.60:4356 , piece_id=IFNZB6TWMUY5PXT7MJTILKGPFCKJYMS54ZF3SHD22T4JCKDGWIQQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422276805 (295h25m46.853356936s) [noise=true , address=77.90.31.11:4574 , piece_id=33LZXW7GYFSGEZMWUEFZR4KMFO24YNVPXVIKKMNQQLJA22MT6LWQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422343223 (295h25m46.853423354s) [noise=true , address=104.36.82.11:4125 , piece_id=MVT6NCX37J7B44WKXUQW2Y7ULQ2DYKUWQFJQN6TIRIEJV5LMRXCA, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422424619 (295h25m46.85350475s) [noise=true , address=104.36.82.45:4915 , piece_id=UOSESRO4UQCOCBZKSI7HCG4VVJGMJFUJZD4K7JCNSH7CC4JCD2DQ, seg_pos={0 0}, upload=307274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT): protocol: expected piece hash; context canceled; EOF
Aug 21 00:51:52.422486076 (295h25m46.853566207s) [seg_pos={0 0}, upload=307274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 00:51:52.422567061 (295h25m46.853647192s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 00:51:52.422571630 (295h25m46.853651761s) [upload=307274]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 00:51:52.902698294 (295h25m47.333778425s) [upload=307274]: Done uploading segments...
Aug 21 00:51:52.902719595 (295h25m47.333799726s) [upload=307274]: Upload finished. err: <nil>
Duration: 6.083935678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..X.........X...........................X..............] duration:
6.243087611s
FAIL (2025-08-21 00:51:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:40:31.791306122 (295h14m26.222386243s) [upload=307073]: Starting upload Aug 21 00:40:31.791365606 (295h14m26.222445727s) [upload=307073]: Done starting upload Aug 21 00:40:31.791489513 (295h14m26.222569644s) [upload=307073]: Uploading segments... Aug 21 00:40:31.791820005 (295h14m26.222900136s) [upload=307073]: Got next segment. Inline: false Aug 21 00:40:31.791874830 (295h14m26.222954961s) [upload=307073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:40:31.791879920 (295h14m26.222960041s) [upload=307073]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 00:40:32.006206384 (295h14m26.437286575s) [upload=307073]: Next segment err: metaclient: Too Many Requests Aug 21 00:40:32.006244537 (295h14m26.437324708s) [upload=307073]: Done uploading segments... Aug 21 00:40:32.006267571 (295h14m26.437347732s) [upload=307073]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.243119722s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.X...........................X.............X..........] duration:
2.055614419s
FAIL (2025-08-21 00:51:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0bc378b04b03cf4203616e6183d40ce6e8323b77acbbb9fc75b3a72429ab045b != before 6a515a53294b909c1192fd19202d72d7cfdf98c47daec6a21abdbfb2f52e3b27 ======LOGS====== Aug 21 00:46:04.695402642 (295h19m59.126482773s) [upload=307170]: Starting upload Aug 21 00:46:04.695462408 (295h19m59.126542539s) [upload=307170]: Done starting upload Aug 21 00:46:04.695529485 (295h19m59.126609617s) [upload=307170]: Uploading segments... Aug 21 00:46:04.695577798 (295h19m59.126657929s) [upload=307170]: Got next segment. Inline: true Aug 21 00:46:04.695582798 (295h19m59.126662929s) [upload=307170]: Waiting for error group managing segments... Aug 21 00:46:04.695650927 (295h19m59.126731068s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:46:04.695656569 (295h19m59.1267367s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:46:04.695662510 (295h19m59.126742631s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:46:05.032709432 (295h19m59.463789563s) [upload=307170]: Done uploading segments... Aug 21 00:46:05.032716816 (295h19m59.463796947s) [upload=307170]: Upload finished. err: <nil>
Duration: 2.055660156s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.X...........................X.............X.........] duration:
1.83941938s
FAIL (2025-08-21 00:51:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0bc378b04b03cf4203616e6183d40ce6e8323b77acbbb9fc75b3a72429ab045b != before 6a515a53294b909c1192fd19202d72d7cfdf98c47daec6a21abdbfb2f52e3b27 ======LOGS====== Aug 21 00:46:04.695402642 (295h19m59.126482773s) [upload=307170]: Starting upload Aug 21 00:46:04.695462408 (295h19m59.126542539s) [upload=307170]: Done starting upload Aug 21 00:46:04.695529485 (295h19m59.126609617s) [upload=307170]: Uploading segments... Aug 21 00:46:04.695577798 (295h19m59.126657929s) [upload=307170]: Got next segment. Inline: true Aug 21 00:46:04.695582798 (295h19m59.126662929s) [upload=307170]: Waiting for error group managing segments... Aug 21 00:46:04.695650927 (295h19m59.126731068s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:46:04.695656569 (295h19m59.1267367s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:46:04.695662510 (295h19m59.126742631s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:46:05.032709432 (295h19m59.463789563s) [upload=307170]: Done uploading segments... Aug 21 00:46:05.032716816 (295h19m59.463796947s) [upload=307170]: Upload finished. err: <nil>
Duration: 1.8394455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.X...........................X.............X........] duration:
1.985123556s
FAIL (2025-08-21 00:50:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0bc378b04b03cf4203616e6183d40ce6e8323b77acbbb9fc75b3a72429ab045b != before 6a515a53294b909c1192fd19202d72d7cfdf98c47daec6a21abdbfb2f52e3b27 ======LOGS====== Aug 21 00:46:04.695402642 (295h19m59.126482773s) [upload=307170]: Starting upload Aug 21 00:46:04.695462408 (295h19m59.126542539s) [upload=307170]: Done starting upload Aug 21 00:46:04.695529485 (295h19m59.126609617s) [upload=307170]: Uploading segments... Aug 21 00:46:04.695577798 (295h19m59.126657929s) [upload=307170]: Got next segment. Inline: true Aug 21 00:46:04.695582798 (295h19m59.126662929s) [upload=307170]: Waiting for error group managing segments... Aug 21 00:46:04.695650927 (295h19m59.126731068s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:46:04.695656569 (295h19m59.1267367s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:46:04.695662510 (295h19m59.126742631s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:46:05.032709432 (295h19m59.463789563s) [upload=307170]: Done uploading segments... Aug 21 00:46:05.032716816 (295h19m59.463796947s) [upload=307170]: Upload finished. err: <nil>
Duration: 1.985149163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X..X.........X...........................X.............] duration:
5.907687218s
FAIL (2025-08-21 00:50:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 00:40:31.791306122 (295h14m26.222386243s) [upload=307073]: Starting upload Aug 21 00:40:31.791365606 (295h14m26.222445727s) [upload=307073]: Done starting upload Aug 21 00:40:31.791489513 (295h14m26.222569644s) [upload=307073]: Uploading segments... Aug 21 00:40:31.791820005 (295h14m26.222900136s) [upload=307073]: Got next segment. Inline: false Aug 21 00:40:31.791874830 (295h14m26.222954961s) [upload=307073]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:40:31.791879920 (295h14m26.222960041s) [upload=307073]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 00:40:32.006206384 (295h14m26.437286575s) [upload=307073]: Next segment err: metaclient: Too Many Requests Aug 21 00:40:32.006244537 (295h14m26.437324708s) [upload=307073]: Done uploading segments... Aug 21 00:40:32.006267571 (295h14m26.437347732s) [upload=307073]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.907713669s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.X...........................X.............X.......] duration:
1.929731181s
FAIL (2025-08-21 00:49:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0bc378b04b03cf4203616e6183d40ce6e8323b77acbbb9fc75b3a72429ab045b != before 6a515a53294b909c1192fd19202d72d7cfdf98c47daec6a21abdbfb2f52e3b27 ======LOGS====== Aug 21 00:46:04.695402642 (295h19m59.126482773s) [upload=307170]: Starting upload Aug 21 00:46:04.695462408 (295h19m59.126542539s) [upload=307170]: Done starting upload Aug 21 00:46:04.695529485 (295h19m59.126609617s) [upload=307170]: Uploading segments... Aug 21 00:46:04.695577798 (295h19m59.126657929s) [upload=307170]: Got next segment. Inline: true Aug 21 00:46:04.695582798 (295h19m59.126662929s) [upload=307170]: Waiting for error group managing segments... Aug 21 00:46:04.695650927 (295h19m59.126731068s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:46:04.695656569 (295h19m59.1267367s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:46:04.695662510 (295h19m59.126742631s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:46:05.032709432 (295h19m59.463789563s) [upload=307170]: Done uploading segments... Aug 21 00:46:05.032716816 (295h19m59.463796947s) [upload=307170]: Upload finished. err: <nil>
Duration: 1.929756338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.X...........................X.............X......] duration:
1.854468545s
FAIL (2025-08-21 00:49:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 0bc378b04b03cf4203616e6183d40ce6e8323b77acbbb9fc75b3a72429ab045b != before 6a515a53294b909c1192fd19202d72d7cfdf98c47daec6a21abdbfb2f52e3b27 ======LOGS====== Aug 21 00:46:04.695402642 (295h19m59.126482773s) [upload=307170]: Starting upload Aug 21 00:46:04.695462408 (295h19m59.126542539s) [upload=307170]: Done starting upload Aug 21 00:46:04.695529485 (295h19m59.126609617s) [upload=307170]: Uploading segments... Aug 21 00:46:04.695577798 (295h19m59.126657929s) [upload=307170]: Got next segment. Inline: true Aug 21 00:46:04.695582798 (295h19m59.126662929s) [upload=307170]: Waiting for error group managing segments... Aug 21 00:46:04.695650927 (295h19m59.126731068s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 00:46:04.695656569 (295h19m59.1267367s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 00:46:04.695662510 (295h19m59.126742631s) [upload=307170]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 00:46:05.032709432 (295h19m59.463789563s) [upload=307170]: Done uploading segments... Aug 21 00:46:05.032716816 (295h19m59.463796947s) [upload=307170]: Upload finished. err: <nil>
Duration: 1.854495868s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|