Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...........X......................] duration:
1.919380611s
FAIL (2025-08-23 18:47:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.919403614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...........X.....................] duration:
1.849829829s
FAIL (2025-08-23 18:47:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.849863032s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X.............X...X................X.......] duration:
6.122111535s
FAIL (2025-08-23 18:46:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6804ef29f75a3c5002175ba4585cb0af6f69ae3ebedc6e28d3292408070be5b0 != before b8de0e6b6295387fe4587b81d3246c48732b8eb053e46808d4c4ef226e25a149
======LOGS======
Aug 23 18:41:50.126489794 (361h15m44.557569916s) [upload=375838]: Starting upload
Aug 23 18:41:50.126564838 (361h15m44.557644969s) [upload=375838]: Done starting upload
Aug 23 18:41:50.126694356 (361h15m44.557774488s) [upload=375838]: Uploading segments...
Aug 23 18:41:50.126813063 (361h15m44.557893194s) [upload=375838]: Got next segment. Inline: false
Aug 23 18:41:50.126844994 (361h15m44.557925125s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 18:41:50.126853521 (361h15m44.557933642s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 18:41:50.625982568 (361h15m45.057062699s) [seg_pos={0 0}, upload=375838]: Begin upload segment...
Aug 23 18:41:50.626049837 (361h15m45.057130008s) [seg_pos={0 0}, upload=375838]: Done begin upload segment.
Aug 23 18:41:50.626090284 (361h15m45.057170485s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626102307 (361h15m45.057182438s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626505208 (361h15m45.057585339s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626556366 (361h15m45.057636497s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626777900 (361h15m45.057858031s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626835360 (361h15m45.057915491s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627048498 (361h15m45.058128629s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627108743 (361h15m45.058188874s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627263169 (361h15m45.05834329s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627321761 (361h15m45.058401892s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627509710 (361h15m45.058589841s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627534027 (361h15m45.058614158s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627745962 (361h15m45.058826093s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627791529 (361h15m45.05887166s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628044343 (361h15m45.059124474s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628270967 (361h15m45.059351098s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628489996 (361h15m45.059570117s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628709216 (361h15m45.059789337s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:52.125498153 (361h15m46.556578295s) [upload=375838]: Next returned nil segment
Aug 23 18:41:52.125523753 (361h15m46.556603884s) [upload=375838]: Waiting for error group managing segments...
Aug 23 18:41:52.558669978 (361h15m46.989750109s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.575778514 (361h15m47.006858645s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.586680364 (361h15m47.017760495s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.650660494 (361h15m47.081740625s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.678870361 (361h15m47.109950492s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.681216430 (361h15m47.112296561s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.702035676 (361h15m47.133115807s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.705025286 (361h15m47.136105407s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.729087377 (361h15m47.160167508s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.828782203 (361h15m47.259862334s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.986159731 (361h15m47.417239862s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.053508537 (361h15m47.484588668s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.064612463 (361h15m47.495692594s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081656346 (361h15m47.512736467s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081681764 (361h15m47.512761895s) [seg_pos={0 0}, upload=375838]: Segment reached optimal threshold of 14 pieces.
Aug 23 18:41:53.081842081 (361h15m47.512922212s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.081965857 (361h15m47.513045989s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.082057894 (361h15m47.513138015s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection
Aug 23 18:41:53.082096047 (361h15m47.513176178s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EiZjV2QMYue3KQDsNRhhdGpCQjybDv54wTuXsJTNtyeV8hHeh): protocol: read tcp 188.166.225.170:44372->104.36.82.11:4139: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 18:41:53.082127737 (361h15m47.513207868s) [seg_pos={0 0}, upload=375838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 18:41:53.082209233 (361h15m47.513289354s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 18:41:53.082213171 (361h15m47.513293302s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 18:41:53.387906126 (361h15m47.818986267s) [upload=375838]: Done uploading segments...
Aug 23 18:41:53.387922337 (361h15m47.819002468s) [upload=375838]: Upload finished. err: <nil>
Duration: 6.122137534s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...........X....................] duration:
2.107521019s
FAIL (2025-08-23 18:46:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 2.107554734s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X...........X...................] duration:
2.026013002s
FAIL (2025-08-23 18:46:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 2.026041055s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X.............X...X................X......] duration:
6.154233894s
FAIL (2025-08-23 18:46:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6804ef29f75a3c5002175ba4585cb0af6f69ae3ebedc6e28d3292408070be5b0 != before b8de0e6b6295387fe4587b81d3246c48732b8eb053e46808d4c4ef226e25a149
======LOGS======
Aug 23 18:41:50.126489794 (361h15m44.557569916s) [upload=375838]: Starting upload
Aug 23 18:41:50.126564838 (361h15m44.557644969s) [upload=375838]: Done starting upload
Aug 23 18:41:50.126694356 (361h15m44.557774488s) [upload=375838]: Uploading segments...
Aug 23 18:41:50.126813063 (361h15m44.557893194s) [upload=375838]: Got next segment. Inline: false
Aug 23 18:41:50.126844994 (361h15m44.557925125s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 18:41:50.126853521 (361h15m44.557933642s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 18:41:50.625982568 (361h15m45.057062699s) [seg_pos={0 0}, upload=375838]: Begin upload segment...
Aug 23 18:41:50.626049837 (361h15m45.057130008s) [seg_pos={0 0}, upload=375838]: Done begin upload segment.
Aug 23 18:41:50.626090284 (361h15m45.057170485s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626102307 (361h15m45.057182438s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626505208 (361h15m45.057585339s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626556366 (361h15m45.057636497s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626777900 (361h15m45.057858031s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626835360 (361h15m45.057915491s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627048498 (361h15m45.058128629s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627108743 (361h15m45.058188874s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627263169 (361h15m45.05834329s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627321761 (361h15m45.058401892s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627509710 (361h15m45.058589841s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627534027 (361h15m45.058614158s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627745962 (361h15m45.058826093s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627791529 (361h15m45.05887166s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628044343 (361h15m45.059124474s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628270967 (361h15m45.059351098s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628489996 (361h15m45.059570117s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628709216 (361h15m45.059789337s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:52.125498153 (361h15m46.556578295s) [upload=375838]: Next returned nil segment
Aug 23 18:41:52.125523753 (361h15m46.556603884s) [upload=375838]: Waiting for error group managing segments...
Aug 23 18:41:52.558669978 (361h15m46.989750109s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.575778514 (361h15m47.006858645s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.586680364 (361h15m47.017760495s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.650660494 (361h15m47.081740625s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.678870361 (361h15m47.109950492s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.681216430 (361h15m47.112296561s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.702035676 (361h15m47.133115807s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.705025286 (361h15m47.136105407s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.729087377 (361h15m47.160167508s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.828782203 (361h15m47.259862334s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.986159731 (361h15m47.417239862s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.053508537 (361h15m47.484588668s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.064612463 (361h15m47.495692594s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081656346 (361h15m47.512736467s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081681764 (361h15m47.512761895s) [seg_pos={0 0}, upload=375838]: Segment reached optimal threshold of 14 pieces.
Aug 23 18:41:53.081842081 (361h15m47.512922212s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.081965857 (361h15m47.513045989s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.082057894 (361h15m47.513138015s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection
Aug 23 18:41:53.082096047 (361h15m47.513176178s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EiZjV2QMYue3KQDsNRhhdGpCQjybDv54wTuXsJTNtyeV8hHeh): protocol: read tcp 188.166.225.170:44372->104.36.82.11:4139: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 18:41:53.082127737 (361h15m47.513207868s) [seg_pos={0 0}, upload=375838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 18:41:53.082209233 (361h15m47.513289354s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 18:41:53.082213171 (361h15m47.513293302s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 18:41:53.387906126 (361h15m47.818986267s) [upload=375838]: Done uploading segments...
Aug 23 18:41:53.387922337 (361h15m47.819002468s) [upload=375838]: Upload finished. err: <nil>
Duration: 6.154265666s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...........X..................] duration:
1.895161948s
FAIL (2025-08-23 18:45:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.89518989s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................X.............X...X................X.....] duration:
5.967352265s
FAIL (2025-08-23 18:45:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6804ef29f75a3c5002175ba4585cb0af6f69ae3ebedc6e28d3292408070be5b0 != before b8de0e6b6295387fe4587b81d3246c48732b8eb053e46808d4c4ef226e25a149
======LOGS======
Aug 23 18:41:50.126489794 (361h15m44.557569916s) [upload=375838]: Starting upload
Aug 23 18:41:50.126564838 (361h15m44.557644969s) [upload=375838]: Done starting upload
Aug 23 18:41:50.126694356 (361h15m44.557774488s) [upload=375838]: Uploading segments...
Aug 23 18:41:50.126813063 (361h15m44.557893194s) [upload=375838]: Got next segment. Inline: false
Aug 23 18:41:50.126844994 (361h15m44.557925125s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 18:41:50.126853521 (361h15m44.557933642s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 18:41:50.625982568 (361h15m45.057062699s) [seg_pos={0 0}, upload=375838]: Begin upload segment...
Aug 23 18:41:50.626049837 (361h15m45.057130008s) [seg_pos={0 0}, upload=375838]: Done begin upload segment.
Aug 23 18:41:50.626090284 (361h15m45.057170485s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626102307 (361h15m45.057182438s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626505208 (361h15m45.057585339s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626556366 (361h15m45.057636497s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626777900 (361h15m45.057858031s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626835360 (361h15m45.057915491s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627048498 (361h15m45.058128629s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627108743 (361h15m45.058188874s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627263169 (361h15m45.05834329s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627321761 (361h15m45.058401892s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627509710 (361h15m45.058589841s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627534027 (361h15m45.058614158s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627745962 (361h15m45.058826093s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627791529 (361h15m45.05887166s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628044343 (361h15m45.059124474s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628270967 (361h15m45.059351098s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628489996 (361h15m45.059570117s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628709216 (361h15m45.059789337s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:52.125498153 (361h15m46.556578295s) [upload=375838]: Next returned nil segment
Aug 23 18:41:52.125523753 (361h15m46.556603884s) [upload=375838]: Waiting for error group managing segments...
Aug 23 18:41:52.558669978 (361h15m46.989750109s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.575778514 (361h15m47.006858645s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.586680364 (361h15m47.017760495s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.650660494 (361h15m47.081740625s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.678870361 (361h15m47.109950492s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.681216430 (361h15m47.112296561s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.702035676 (361h15m47.133115807s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.705025286 (361h15m47.136105407s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.729087377 (361h15m47.160167508s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.828782203 (361h15m47.259862334s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.986159731 (361h15m47.417239862s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.053508537 (361h15m47.484588668s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.064612463 (361h15m47.495692594s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081656346 (361h15m47.512736467s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081681764 (361h15m47.512761895s) [seg_pos={0 0}, upload=375838]: Segment reached optimal threshold of 14 pieces.
Aug 23 18:41:53.081842081 (361h15m47.512922212s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.081965857 (361h15m47.513045989s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.082057894 (361h15m47.513138015s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection
Aug 23 18:41:53.082096047 (361h15m47.513176178s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EiZjV2QMYue3KQDsNRhhdGpCQjybDv54wTuXsJTNtyeV8hHeh): protocol: read tcp 188.166.225.170:44372->104.36.82.11:4139: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 18:41:53.082127737 (361h15m47.513207868s) [seg_pos={0 0}, upload=375838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 18:41:53.082209233 (361h15m47.513289354s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 18:41:53.082213171 (361h15m47.513293302s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 18:41:53.387906126 (361h15m47.818986267s) [upload=375838]: Done uploading segments...
Aug 23 18:41:53.387922337 (361h15m47.819002468s) [upload=375838]: Upload finished. err: <nil>
Duration: 5.96738112s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................X.............X...X................X....] duration:
5.753307921s
FAIL (2025-08-23 18:44:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6804ef29f75a3c5002175ba4585cb0af6f69ae3ebedc6e28d3292408070be5b0 != before b8de0e6b6295387fe4587b81d3246c48732b8eb053e46808d4c4ef226e25a149
======LOGS======
Aug 23 18:41:50.126489794 (361h15m44.557569916s) [upload=375838]: Starting upload
Aug 23 18:41:50.126564838 (361h15m44.557644969s) [upload=375838]: Done starting upload
Aug 23 18:41:50.126694356 (361h15m44.557774488s) [upload=375838]: Uploading segments...
Aug 23 18:41:50.126813063 (361h15m44.557893194s) [upload=375838]: Got next segment. Inline: false
Aug 23 18:41:50.126844994 (361h15m44.557925125s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 18:41:50.126853521 (361h15m44.557933642s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 18:41:50.625982568 (361h15m45.057062699s) [seg_pos={0 0}, upload=375838]: Begin upload segment...
Aug 23 18:41:50.626049837 (361h15m45.057130008s) [seg_pos={0 0}, upload=375838]: Done begin upload segment.
Aug 23 18:41:50.626090284 (361h15m45.057170485s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626102307 (361h15m45.057182438s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626505208 (361h15m45.057585339s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626556366 (361h15m45.057636497s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626777900 (361h15m45.057858031s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626835360 (361h15m45.057915491s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627048498 (361h15m45.058128629s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627108743 (361h15m45.058188874s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627263169 (361h15m45.05834329s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627321761 (361h15m45.058401892s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627509710 (361h15m45.058589841s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627534027 (361h15m45.058614158s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627745962 (361h15m45.058826093s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627791529 (361h15m45.05887166s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628044343 (361h15m45.059124474s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628270967 (361h15m45.059351098s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628489996 (361h15m45.059570117s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628709216 (361h15m45.059789337s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:52.125498153 (361h15m46.556578295s) [upload=375838]: Next returned nil segment
Aug 23 18:41:52.125523753 (361h15m46.556603884s) [upload=375838]: Waiting for error group managing segments...
Aug 23 18:41:52.558669978 (361h15m46.989750109s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.575778514 (361h15m47.006858645s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.586680364 (361h15m47.017760495s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.650660494 (361h15m47.081740625s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.678870361 (361h15m47.109950492s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.681216430 (361h15m47.112296561s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.702035676 (361h15m47.133115807s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.705025286 (361h15m47.136105407s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.729087377 (361h15m47.160167508s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.828782203 (361h15m47.259862334s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.986159731 (361h15m47.417239862s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.053508537 (361h15m47.484588668s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.064612463 (361h15m47.495692594s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081656346 (361h15m47.512736467s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081681764 (361h15m47.512761895s) [seg_pos={0 0}, upload=375838]: Segment reached optimal threshold of 14 pieces.
Aug 23 18:41:53.081842081 (361h15m47.512922212s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.081965857 (361h15m47.513045989s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.082057894 (361h15m47.513138015s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection
Aug 23 18:41:53.082096047 (361h15m47.513176178s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EiZjV2QMYue3KQDsNRhhdGpCQjybDv54wTuXsJTNtyeV8hHeh): protocol: read tcp 188.166.225.170:44372->104.36.82.11:4139: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 18:41:53.082127737 (361h15m47.513207868s) [seg_pos={0 0}, upload=375838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 18:41:53.082209233 (361h15m47.513289354s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 18:41:53.082213171 (361h15m47.513293302s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 18:41:53.387906126 (361h15m47.818986267s) [upload=375838]: Done uploading segments...
Aug 23 18:41:53.387922337 (361h15m47.819002468s) [upload=375838]: Upload finished. err: <nil>
Duration: 5.753337758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X...........X.................] duration:
1.850092132s
FAIL (2025-08-23 18:44:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.850139764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X....................X.............X...X................X...] duration:
5.949145169s
FAIL (2025-08-23 18:44:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6804ef29f75a3c5002175ba4585cb0af6f69ae3ebedc6e28d3292408070be5b0 != before b8de0e6b6295387fe4587b81d3246c48732b8eb053e46808d4c4ef226e25a149
======LOGS======
Aug 23 18:41:50.126489794 (361h15m44.557569916s) [upload=375838]: Starting upload
Aug 23 18:41:50.126564838 (361h15m44.557644969s) [upload=375838]: Done starting upload
Aug 23 18:41:50.126694356 (361h15m44.557774488s) [upload=375838]: Uploading segments...
Aug 23 18:41:50.126813063 (361h15m44.557893194s) [upload=375838]: Got next segment. Inline: false
Aug 23 18:41:50.126844994 (361h15m44.557925125s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 18:41:50.126853521 (361h15m44.557933642s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 18:41:50.625982568 (361h15m45.057062699s) [seg_pos={0 0}, upload=375838]: Begin upload segment...
Aug 23 18:41:50.626049837 (361h15m45.057130008s) [seg_pos={0 0}, upload=375838]: Done begin upload segment.
Aug 23 18:41:50.626090284 (361h15m45.057170485s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626102307 (361h15m45.057182438s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626505208 (361h15m45.057585339s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626556366 (361h15m45.057636497s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626777900 (361h15m45.057858031s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626835360 (361h15m45.057915491s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627048498 (361h15m45.058128629s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627108743 (361h15m45.058188874s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627263169 (361h15m45.05834329s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627321761 (361h15m45.058401892s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627509710 (361h15m45.058589841s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627534027 (361h15m45.058614158s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627745962 (361h15m45.058826093s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627791529 (361h15m45.05887166s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628044343 (361h15m45.059124474s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628270967 (361h15m45.059351098s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628489996 (361h15m45.059570117s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628709216 (361h15m45.059789337s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:52.125498153 (361h15m46.556578295s) [upload=375838]: Next returned nil segment
Aug 23 18:41:52.125523753 (361h15m46.556603884s) [upload=375838]: Waiting for error group managing segments...
Aug 23 18:41:52.558669978 (361h15m46.989750109s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.575778514 (361h15m47.006858645s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.586680364 (361h15m47.017760495s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.650660494 (361h15m47.081740625s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.678870361 (361h15m47.109950492s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.681216430 (361h15m47.112296561s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.702035676 (361h15m47.133115807s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.705025286 (361h15m47.136105407s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.729087377 (361h15m47.160167508s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.828782203 (361h15m47.259862334s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.986159731 (361h15m47.417239862s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.053508537 (361h15m47.484588668s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.064612463 (361h15m47.495692594s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081656346 (361h15m47.512736467s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081681764 (361h15m47.512761895s) [seg_pos={0 0}, upload=375838]: Segment reached optimal threshold of 14 pieces.
Aug 23 18:41:53.081842081 (361h15m47.512922212s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.081965857 (361h15m47.513045989s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.082057894 (361h15m47.513138015s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection
Aug 23 18:41:53.082096047 (361h15m47.513176178s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EiZjV2QMYue3KQDsNRhhdGpCQjybDv54wTuXsJTNtyeV8hHeh): protocol: read tcp 188.166.225.170:44372->104.36.82.11:4139: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 18:41:53.082127737 (361h15m47.513207868s) [seg_pos={0 0}, upload=375838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 18:41:53.082209233 (361h15m47.513289354s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 18:41:53.082213171 (361h15m47.513293302s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 18:41:53.387906126 (361h15m47.818986267s) [upload=375838]: Done uploading segments...
Aug 23 18:41:53.387922337 (361h15m47.819002468s) [upload=375838]: Upload finished. err: <nil>
Duration: 5.949180357s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X..............................X...........X................] duration:
1.832163136s
FAIL (2025-08-23 18:43:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.832190377s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X....................X.............X...X................X..] duration:
6.056578491s
FAIL (2025-08-23 18:43:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6804ef29f75a3c5002175ba4585cb0af6f69ae3ebedc6e28d3292408070be5b0 != before b8de0e6b6295387fe4587b81d3246c48732b8eb053e46808d4c4ef226e25a149
======LOGS======
Aug 23 18:41:50.126489794 (361h15m44.557569916s) [upload=375838]: Starting upload
Aug 23 18:41:50.126564838 (361h15m44.557644969s) [upload=375838]: Done starting upload
Aug 23 18:41:50.126694356 (361h15m44.557774488s) [upload=375838]: Uploading segments...
Aug 23 18:41:50.126813063 (361h15m44.557893194s) [upload=375838]: Got next segment. Inline: false
Aug 23 18:41:50.126844994 (361h15m44.557925125s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 18:41:50.126853521 (361h15m44.557933642s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 18:41:50.625982568 (361h15m45.057062699s) [seg_pos={0 0}, upload=375838]: Begin upload segment...
Aug 23 18:41:50.626049837 (361h15m45.057130008s) [seg_pos={0 0}, upload=375838]: Done begin upload segment.
Aug 23 18:41:50.626090284 (361h15m45.057170485s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626102307 (361h15m45.057182438s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626505208 (361h15m45.057585339s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626556366 (361h15m45.057636497s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626777900 (361h15m45.057858031s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626835360 (361h15m45.057915491s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627048498 (361h15m45.058128629s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627108743 (361h15m45.058188874s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627263169 (361h15m45.05834329s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627321761 (361h15m45.058401892s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627509710 (361h15m45.058589841s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627534027 (361h15m45.058614158s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627745962 (361h15m45.058826093s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627791529 (361h15m45.05887166s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628044343 (361h15m45.059124474s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628270967 (361h15m45.059351098s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628489996 (361h15m45.059570117s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628709216 (361h15m45.059789337s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:52.125498153 (361h15m46.556578295s) [upload=375838]: Next returned nil segment
Aug 23 18:41:52.125523753 (361h15m46.556603884s) [upload=375838]: Waiting for error group managing segments...
Aug 23 18:41:52.558669978 (361h15m46.989750109s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.575778514 (361h15m47.006858645s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.586680364 (361h15m47.017760495s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.650660494 (361h15m47.081740625s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.678870361 (361h15m47.109950492s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.681216430 (361h15m47.112296561s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.702035676 (361h15m47.133115807s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.705025286 (361h15m47.136105407s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.729087377 (361h15m47.160167508s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.828782203 (361h15m47.259862334s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.986159731 (361h15m47.417239862s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.053508537 (361h15m47.484588668s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.064612463 (361h15m47.495692594s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081656346 (361h15m47.512736467s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081681764 (361h15m47.512761895s) [seg_pos={0 0}, upload=375838]: Segment reached optimal threshold of 14 pieces.
Aug 23 18:41:53.081842081 (361h15m47.512922212s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.081965857 (361h15m47.513045989s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.082057894 (361h15m47.513138015s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection
Aug 23 18:41:53.082096047 (361h15m47.513176178s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EiZjV2QMYue3KQDsNRhhdGpCQjybDv54wTuXsJTNtyeV8hHeh): protocol: read tcp 188.166.225.170:44372->104.36.82.11:4139: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 18:41:53.082127737 (361h15m47.513207868s) [seg_pos={0 0}, upload=375838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 18:41:53.082209233 (361h15m47.513289354s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 18:41:53.082213171 (361h15m47.513293302s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 18:41:53.387906126 (361h15m47.818986267s) [upload=375838]: Done uploading segments...
Aug 23 18:41:53.387922337 (361h15m47.819002468s) [upload=375838]: Upload finished. err: <nil>
Duration: 6.056684995s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X..............................X...........X...............] duration:
1.881046731s
FAIL (2025-08-23 18:42:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.881074905s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X....................X.............X...X................X.] duration:
5.790386097s
FAIL (2025-08-23 18:42:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6804ef29f75a3c5002175ba4585cb0af6f69ae3ebedc6e28d3292408070be5b0 != before b8de0e6b6295387fe4587b81d3246c48732b8eb053e46808d4c4ef226e25a149
======LOGS======
Aug 23 18:41:50.126489794 (361h15m44.557569916s) [upload=375838]: Starting upload
Aug 23 18:41:50.126564838 (361h15m44.557644969s) [upload=375838]: Done starting upload
Aug 23 18:41:50.126694356 (361h15m44.557774488s) [upload=375838]: Uploading segments...
Aug 23 18:41:50.126813063 (361h15m44.557893194s) [upload=375838]: Got next segment. Inline: false
Aug 23 18:41:50.126844994 (361h15m44.557925125s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 18:41:50.126853521 (361h15m44.557933642s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 18:41:50.625982568 (361h15m45.057062699s) [seg_pos={0 0}, upload=375838]: Begin upload segment...
Aug 23 18:41:50.626049837 (361h15m45.057130008s) [seg_pos={0 0}, upload=375838]: Done begin upload segment.
Aug 23 18:41:50.626090284 (361h15m45.057170485s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626102307 (361h15m45.057182438s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626505208 (361h15m45.057585339s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626556366 (361h15m45.057636497s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626777900 (361h15m45.057858031s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626835360 (361h15m45.057915491s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627048498 (361h15m45.058128629s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627108743 (361h15m45.058188874s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627263169 (361h15m45.05834329s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627321761 (361h15m45.058401892s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627509710 (361h15m45.058589841s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627534027 (361h15m45.058614158s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627745962 (361h15m45.058826093s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627791529 (361h15m45.05887166s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628044343 (361h15m45.059124474s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628270967 (361h15m45.059351098s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628489996 (361h15m45.059570117s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628709216 (361h15m45.059789337s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:52.125498153 (361h15m46.556578295s) [upload=375838]: Next returned nil segment
Aug 23 18:41:52.125523753 (361h15m46.556603884s) [upload=375838]: Waiting for error group managing segments...
Aug 23 18:41:52.558669978 (361h15m46.989750109s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.575778514 (361h15m47.006858645s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.586680364 (361h15m47.017760495s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.650660494 (361h15m47.081740625s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.678870361 (361h15m47.109950492s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.681216430 (361h15m47.112296561s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.702035676 (361h15m47.133115807s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.705025286 (361h15m47.136105407s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.729087377 (361h15m47.160167508s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.828782203 (361h15m47.259862334s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.986159731 (361h15m47.417239862s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.053508537 (361h15m47.484588668s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.064612463 (361h15m47.495692594s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081656346 (361h15m47.512736467s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081681764 (361h15m47.512761895s) [seg_pos={0 0}, upload=375838]: Segment reached optimal threshold of 14 pieces.
Aug 23 18:41:53.081842081 (361h15m47.512922212s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.081965857 (361h15m47.513045989s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.082057894 (361h15m47.513138015s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection
Aug 23 18:41:53.082096047 (361h15m47.513176178s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EiZjV2QMYue3KQDsNRhhdGpCQjybDv54wTuXsJTNtyeV8hHeh): protocol: read tcp 188.166.225.170:44372->104.36.82.11:4139: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 18:41:53.082127737 (361h15m47.513207868s) [seg_pos={0 0}, upload=375838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 18:41:53.082209233 (361h15m47.513289354s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 18:41:53.082213171 (361h15m47.513293302s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 18:41:53.387906126 (361h15m47.818986267s) [upload=375838]: Done uploading segments...
Aug 23 18:41:53.387922337 (361h15m47.819002468s) [upload=375838]: Upload finished. err: <nil>
Duration: 5.790417567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X..............................X...........X..............] duration:
1.849933099s
FAIL (2025-08-23 18:42:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.849961534s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X....................X.............X...X................X] duration:
6.265312392s
FAIL (2025-08-23 18:41:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6804ef29f75a3c5002175ba4585cb0af6f69ae3ebedc6e28d3292408070be5b0 != before b8de0e6b6295387fe4587b81d3246c48732b8eb053e46808d4c4ef226e25a149
======LOGS======
Aug 23 18:41:50.126489794 (361h15m44.557569916s) [upload=375838]: Starting upload
Aug 23 18:41:50.126564838 (361h15m44.557644969s) [upload=375838]: Done starting upload
Aug 23 18:41:50.126694356 (361h15m44.557774488s) [upload=375838]: Uploading segments...
Aug 23 18:41:50.126813063 (361h15m44.557893194s) [upload=375838]: Got next segment. Inline: false
Aug 23 18:41:50.126844994 (361h15m44.557925125s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 18:41:50.126853521 (361h15m44.557933642s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 18:41:50.625982568 (361h15m45.057062699s) [seg_pos={0 0}, upload=375838]: Begin upload segment...
Aug 23 18:41:50.626049837 (361h15m45.057130008s) [seg_pos={0 0}, upload=375838]: Done begin upload segment.
Aug 23 18:41:50.626090284 (361h15m45.057170485s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626102307 (361h15m45.057182438s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626505208 (361h15m45.057585339s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626556366 (361h15m45.057636497s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626777900 (361h15m45.057858031s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.626835360 (361h15m45.057915491s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627048498 (361h15m45.058128629s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627108743 (361h15m45.058188874s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627263169 (361h15m45.05834329s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627321761 (361h15m45.058401892s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627509710 (361h15m45.058589841s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627534027 (361h15m45.058614158s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627745962 (361h15m45.058826093s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.627791529 (361h15m45.05887166s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628044343 (361h15m45.059124474s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628270967 (361h15m45.059351098s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628489996 (361h15m45.059570117s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:50.628709216 (361h15m45.059789337s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Uploading piece...
Aug 23 18:41:52.125498153 (361h15m46.556578295s) [upload=375838]: Next returned nil segment
Aug 23 18:41:52.125523753 (361h15m46.556603884s) [upload=375838]: Waiting for error group managing segments...
Aug 23 18:41:52.558669978 (361h15m46.989750109s) [noise=true , address=104.36.82.41:4787 , piece_id=ESOXXKPOTZOH45BE3KO5Z66HTJ3PTWDMFQ3GJWBBTLSRSJEQTHTA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.575778514 (361h15m47.006858645s) [noise=true , address=104.36.82.8:4975 , piece_id=F7LYSGJEAXFWXT5IZTBQI3VLMIS6EY3J4QUVFVBJAUJG6Q7FGOCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.586680364 (361h15m47.017760495s) [noise=true , address=104.36.82.54:4160 , piece_id=T2H4Y6ANSPH2FWC57ED6BOI5YR6OTRV2BNEY5R5RYGGM6OBGAM5Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.650660494 (361h15m47.081740625s) [noise=true , address=104.36.82.15:4292 , piece_id=JRZVDDA4RSZH2ZPZ5IFXJDCGZF7UWAH65DV6ZISQFJETW4UJL5BA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.678870361 (361h15m47.109950492s) [noise=true , address=77.90.31.16:4750 , piece_id=ZIU3YHWMPSXFKR6GFVZQZNNHKBXCP6PH4G3CDW4CASX7RWZDKTCQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.681216430 (361h15m47.112296561s) [noise=true , address=45.91.116.4:4959 , piece_id=PK5IFQCVF52GHRVA33TWIJYKOWHGLS5UEOD3G3KVIBIR3GLLYPDQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.702035676 (361h15m47.133115807s) [noise=true , address=77.90.31.12:4618 , piece_id=JV5ZIC6GRP67F4DQVZ6TG3TEHYCFZSR2BFDTMZ7AG3CJ3PWBLGOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.705025286 (361h15m47.136105407s) [noise=true , address=104.36.82.6:4880 , piece_id=MXHADZ2BSLIIGIZAXBI73DLVYUIVV6XDHDN6EFDSDLNW5TGRY7KQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.729087377 (361h15m47.160167508s) [noise=true , address=77.90.31.21:4903 , piece_id=HVPPOBL4K3MJ3XD5RYXGN7BDANDMK4PG6IHK3FFW2CMJYLTU7D4Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.828782203 (361h15m47.259862334s) [noise=true , address=104.36.82.23:4446 , piece_id=OKZNRVJSLMILG7LTZ4YFAQ263U6DV5DPBXKKVVJI625ZSUMUBZJA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:52.986159731 (361h15m47.417239862s) [noise=true , address=104.36.82.10:4109 , piece_id=A2IWWN4HOEWZEXHONH2OWRSODPXV3UQ7LBM7DDPVXYFPIVV62TOQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.053508537 (361h15m47.484588668s) [noise=true , address=104.36.82.60:4363 , piece_id=XDQLXEHXS3SCYAT4KC6XWNF55SSN3YAU7A6SSNW6R3TD7JCFB6JA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.064612463 (361h15m47.495692594s) [noise=true , address=77.90.31.11:4585 , piece_id=UAVHV4M7OQUKLTNQBL7GI7IBM6WIA62UEFLPV3OQLJYE2ZEC434Q, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081656346 (361h15m47.512736467s) [noise=true , address=104.36.82.61:4397 , piece_id=G7JF3IXPYPC2E7FXMPTU4JS4VY6FRNSE7HMOBTNTKQSJU4BT5TTQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: <nil>
Aug 23 18:41:53.081681764 (361h15m47.512761895s) [seg_pos={0 0}, upload=375838]: Segment reached optimal threshold of 14 pieces.
Aug 23 18:41:53.081842081 (361h15m47.512922212s) [noise=true , address=45.91.116.9:4277 , piece_id=OLGNYYXWBFFGT5FXIVUKZDI32GSPGPKGSI2424EAXFCZF4NNETVA, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wAuJKermCFTxgfjkq9sq54XDhXJvQN1FrM491irH1dFpDp51v): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.081965857 (361h15m47.513045989s) [noise=true , address=104.36.82.9:4010 , piece_id=E6UELZ37KYMJI4X7VXRMWPSSH6XLU4EZBN6YU2YLIZTIJ53TWMUQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 23 18:41:53.082057894 (361h15m47.513138015s) [noise=true , address=77.90.31.12:4606 , piece_id=D24MTGAJRFH53SD7PW3GK2TCF7LYZU5EZIEBIYLAEBJ63IIJPKPQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45836->77.90.31.12:4606: use of closed network connection
Aug 23 18:41:53.082096047 (361h15m47.513176178s) [noise=true , address=104.36.82.11:4139 , piece_id=5HPHCK2MYT2ZJESQIQEUQXTTL2CZDLR6QX5GK24RSBWPIYG5BXAQ, seg_pos={0 0}, upload=375838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EiZjV2QMYue3KQDsNRhhdGpCQjybDv54wTuXsJTNtyeV8hHeh): protocol: read tcp 188.166.225.170:44372->104.36.82.11:4139: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 23 18:41:53.082127737 (361h15m47.513207868s) [seg_pos={0 0}, upload=375838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 18:41:53.082209233 (361h15m47.513289354s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 18:41:53.082213171 (361h15m47.513293302s) [upload=375838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 18:41:53.387906126 (361h15m47.818986267s) [upload=375838]: Done uploading segments...
Aug 23 18:41:53.387922337 (361h15m47.819002468s) [upload=375838]: Upload finished. err: <nil>
Duration: 6.265340456s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X....................X.............X...X................] duration:
6.361083114s
FAIL (2025-08-23 18:41:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.361108462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X..............................X...........X.............] duration:
1.871867849s
FAIL (2025-08-23 18:41:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.87189414s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X..............................X...........X............] duration:
1.846633295s
FAIL (2025-08-23 18:40:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.846660858s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X....................X.............X...X...............] duration:
6.117509056s
FAIL (2025-08-23 18:40:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.117595633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X....................X.............X...X..............] duration:
6.31035529s
FAIL (2025-08-23 18:39:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.310380789s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X..............................X...........X...........] duration:
1.901589267s
FAIL (2025-08-23 18:39:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.901623142s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X....................X.............X...X.............] duration:
6.181757701s
FAIL (2025-08-23 18:39:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.181777088s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X..............................X...........X..........] duration:
1.85798191s
FAIL (2025-08-23 18:39:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.858007257s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X....................X.............X...X............] duration:
6.153474659s
FAIL (2025-08-23 18:38:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.153497815s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X..............................X...........X.........] duration:
1.936797419s
FAIL (2025-08-23 18:38:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.936814833s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X........X....................X.............X...X...........] duration:
6.222790725s
FAIL (2025-08-23 18:37:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.222814961s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X..............................X...........X........] duration:
1.804639181s
FAIL (2025-08-23 18:37:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.804685758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X........X....................X.............X...X..........] duration:
6.139554779s
FAIL (2025-08-23 18:36:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.139584204s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X........X....................X.............X...X.........] duration:
6.179465204s
FAIL (2025-08-23 18:36:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.179490532s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..............................X...........X.......] duration:
1.995817532s
FAIL (2025-08-23 18:36:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.995840817s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [X..X........X....................X.............X...X........] duration:
6.097247077s
FAIL (2025-08-23 18:35:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.097279668s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..............................X...........X......] duration:
1.952651376s
FAIL (2025-08-23 18:35:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.952676805s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X..X........X....................X.............X...X.......] duration:
6.480142881s
FAIL (2025-08-23 18:35:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.48016862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X..X........X....................X.............X...X......] duration:
6.05187543s
FAIL (2025-08-23 18:34:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.051892674s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..............................X...........X.....] duration:
1.880069727s
FAIL (2025-08-23 18:34:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.880096638s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X..X........X....................X.............X...X.....] duration:
6.26315676s
FAIL (2025-08-23 18:33:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.263189823s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..............................X...........X....] duration:
2.019304491s
FAIL (2025-08-23 18:33:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 2.019331222s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X..X........X....................X.............X...X....] duration:
6.466679231s
FAIL (2025-08-23 18:32:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.466704379s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..............................X...........X...] duration:
1.953414927s
FAIL (2025-08-23 18:32:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.953441798s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X..X........X....................X.............X...X...] duration:
6.456541404s
FAIL (2025-08-23 18:31:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.45656563s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..............................X...........X..] duration:
1.848412786s
FAIL (2025-08-23 18:31:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.848471898s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X..............................X...........X.] duration:
1.834580248s
FAIL (2025-08-23 18:30:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.834610123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X..X........X....................X.............X...X..] duration:
5.713870227s
FAIL (2025-08-23 18:30:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.713898391s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X..............................X...........X] duration:
1.683998215s
FAIL (2025-08-23 18:30:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e0c7f7a2f0a7c914db67866acad35c6b6af7eee5d435edd599c3272f2fb9750a != before 8e6710e6087610bc5ae2d26fbd67d86ba1f334bb14d26f005a3573efa67b2d52 ======LOGS====== Aug 23 18:30:31.767782541 (361h4m26.198862672s) [upload=375637]: Starting upload Aug 23 18:30:31.767826255 (361h4m26.198906386s) [upload=375637]: Done starting upload Aug 23 18:30:31.767875549 (361h4m26.19895568s) [upload=375637]: Uploading segments... Aug 23 18:30:31.767910205 (361h4m26.198990336s) [upload=375637]: Got next segment. Inline: true Aug 23 18:30:31.767913762 (361h4m26.198993893s) [upload=375637]: Waiting for error group managing segments... Aug 23 18:30:31.767945893 (361h4m26.199026024s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:30:31.767949881 (361h4m26.199030012s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:30:31.767952726 (361h4m26.199032857s) [upload=375637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:30:32.055395393 (361h4m26.486475524s) [upload=375637]: Done uploading segments... Aug 23 18:30:32.055415512 (361h4m26.486495633s) [upload=375637]: Upload finished. err: <nil>
Duration: 1.684034013s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X..X........X....................X.............X...X.] duration:
6.643248101s
FAIL (2025-08-23 18:30:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.643277767s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X..............................X...........] duration:
2.074928102s
FAIL (2025-08-23 18:29:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 18:22:17.020817003 (360h56m11.451897144s) [upload=375487]: Starting upload Aug 23 18:22:17.020892417 (360h56m11.451972548s) [upload=375487]: Done starting upload Aug 23 18:22:17.021012597 (360h56m11.452092728s) [upload=375487]: Uploading segments... Aug 23 18:22:17.021050089 (360h56m11.45213022s) [upload=375487]: Got next segment. Inline: true Aug 23 18:22:17.021055820 (360h56m11.452135951s) [upload=375487]: Waiting for error group managing segments... Aug 23 18:22:17.021119592 (360h56m11.452199733s) [upload=375487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:22:17.021124982 (360h56m11.452205123s) [upload=375487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:22:17.021128639 (360h56m11.45220877s) [upload=375487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:22:17.315437867 (360h56m11.746517998s) [upload=375487]: Done uploading segments... Aug 23 18:22:17.315455269 (360h56m11.74653539s) [upload=375487]: Upload finished. err: <nil>
Duration: 2.074956857s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X..............................X..........] duration:
1.843979193s
FAIL (2025-08-23 18:29:20 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 18:22:17.020817003 (360h56m11.451897144s) [upload=375487]: Starting upload Aug 23 18:22:17.020892417 (360h56m11.451972548s) [upload=375487]: Done starting upload Aug 23 18:22:17.021012597 (360h56m11.452092728s) [upload=375487]: Uploading segments... Aug 23 18:22:17.021050089 (360h56m11.45213022s) [upload=375487]: Got next segment. Inline: true Aug 23 18:22:17.021055820 (360h56m11.452135951s) [upload=375487]: Waiting for error group managing segments... Aug 23 18:22:17.021119592 (360h56m11.452199733s) [upload=375487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:22:17.021124982 (360h56m11.452205123s) [upload=375487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 18:22:17.021128639 (360h56m11.45220877s) [upload=375487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 18:22:17.315437867 (360h56m11.746517998s) [upload=375487]: Done uploading segments... Aug 23 18:22:17.315455269 (360h56m11.74653539s) [upload=375487]: Upload finished. err: <nil>
Duration: 1.844004621s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X..X........X....................X.............X...X] duration:
960.975661ms
FAIL (2025-08-23 18:29:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 18:29:12.459195378 (361h3m6.890275509s) [upload=375612]: Starting upload Aug 23 18:29:12.459241365 (361h3m6.890321496s) [upload=375612]: Done starting upload Aug 23 18:29:12.459299426 (361h3m6.890379557s) [upload=375612]: Uploading segments... Aug 23 18:29:12.459433653 (361h3m6.890513784s) [upload=375612]: Got next segment. Inline: false Aug 23 18:29:12.459465835 (361h3m6.890546016s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 18:29:12.459473059 (361h3m6.8905532s) [upload=375612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 18:29:12.765846647 (361h3m7.196926778s) [upload=375612]: Next segment err: metaclient: Too Many Requests Aug 23 18:29:12.765874320 (361h3m7.196954451s) [upload=375612]: Done uploading segments... Aug 23 18:29:12.765892876 (361h3m7.196973007s) [upload=375612]: Upload finished. err: metaclient: Too Many Requests
Duration: 961.000769ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|