Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X........................X................................X.] duration:
6.044278247s
FAIL (2025-08-12 21:48:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 21:47:51.649232048 (100h21m46.080312179s) [upload=104535]: Starting upload
Aug 12 21:47:51.649295779 (100h21m46.080375911s) [upload=104535]: Done starting upload
Aug 12 21:47:51.649381253 (100h21m46.080461384s) [upload=104535]: Uploading segments...
Aug 12 21:47:51.649528165 (100h21m46.080608296s) [upload=104535]: Got next segment. Inline: false
Aug 12 21:47:51.649552431 (100h21m46.080632562s) [upload=104535]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:47:51.649557841 (100h21m46.080637962s) [upload=104535]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:47:52.110429958 (100h21m46.541510089s) [seg_pos={0 0}, upload=104535]: Begin upload segment...
Aug 12 21:47:52.110477378 (100h21m46.541557499s) [seg_pos={0 0}, upload=104535]: Done begin upload segment.
Aug 12 21:47:52.110498188 (100h21m46.541578319s) [noise=true , address=193.149.164.143:4698 , piece_id=SCYWXOWOCRZSG5GCHFEJTNZ3QS2ZFSPSFCZJ7TEAJAFN3PKEWJKQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.110547041 (100h21m46.541627172s) [noise=true , address=104.36.82.36:4642 , piece_id=CMSKH3IPW3X35EVF6OB7RR75SMW2YTOX64LFVW7443JSJVU4HVSQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.110906279 (100h21m46.54198641s) [noise=true , address=64.49.13.27:4961 , piece_id=FGUMNYVMIAT4FJEGWCOTZJ35MJ346SH5OMCKZAVV6XL6WAEPVZVA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111266628 (100h21m46.542346759s) [noise=true , address=104.36.82.59:4319 , piece_id=MKUJT373U46OC2QVSZXL33TLNPK47ZTVN74H7VBIEZVLCTOBJJCQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111336292 (100h21m46.542416423s) [noise=true , address=104.36.82.51:4081 , piece_id=KKKKNJ4K2WEFMU3C43IVNBZPP7MFLDCNQ6KTNNMKP5P6GLPR3O3A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111540592 (100h21m46.542620723s) [noise=true , address=104.36.82.62:4412 , piece_id=BRACWH5HYXLUGQOS5SCLJSB3WTOHIVO4S6ETKTSCHEV6JFONVRAQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111620936 (100h21m46.542701057s) [noise=true , address=104.36.82.60:4347 , piece_id=TCYRG74HEVF4R7GJ766JYIVR6SGSGKFS2WSVLNWRDBIZIBTRLHDA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111834104 (100h21m46.542914225s) [noise=true , address=104.36.82.5:4851 , piece_id=IQEMMHRRVXTBVUODNMXYDV3BE7F6TUSZISPKTW7MD42ATFPOPXVA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.112148575 (100h21m46.543228696s) [noise=true , address=64.49.13.170:4727 , piece_id=TKXDZCY42Y2EKAR6HCOVNK7STBD4BUKM7SQ5SJLSFVGW6IREBT6A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.112415416 (100h21m46.543495547s) [noise=true , address=104.36.82.62:4419 , piece_id=2IJB4X5NM563KUKCACHB2VFXCHIXY6FSQOCGX656C4XHPW7EOJ4A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.112616631 (100h21m46.543696762s) [noise=true , address=104.36.82.14:4235 , piece_id=44HDKGYEW7WRGRPMHWBBO5AGY6EO5CEEMEE5EGHKIPUQMROPJULA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.112850339 (100h21m46.54393047s) [noise=true , address=104.36.82.23:4446 , piece_id=L6BITHHC3GU4LAZYBMCB7EAIGOGZOXIZAX4FZ5HDK3CTWDQSGHVQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113100978 (100h21m46.544181109s) [noise=true , address=64.49.13.138:4484 , piece_id=5TFFNQAGTHJH2JDXVVLYK55FCZ7GB6G2YKJQJVDF5TF32FB6H34A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113317673 (100h21m46.544397804s) [noise=true , address=104.36.82.37:4656 , piece_id=TTNGCRGN7M2W77HFJZOZIV622OXAUOOS2TPUZ6PLBFWCP3EOTSXA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113505943 (100h21m46.544586074s) [noise=true , address=79.127.220.101:4074 , piece_id=MDCOXYRY2NCY4BKILF3V6EBT267HLRITQXSLVNDPYQQRB4W3GMFA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113689474 (100h21m46.544769595s) [noise=true , address=79.127.201.215:4356 , piece_id=EAAOPXUIEUNXRLVUHZPUGXPQ2SM6CB6N53U6YONZJKLMRKQHQRNA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113897442 (100h21m46.544977573s) [noise=true , address=104.36.82.19:4403 , piece_id=5LENVCU4TRI3HNQDD42YWFSTGZAPDICMO44RZW77U7RBLFE7W65A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.114085722 (100h21m46.545165853s) [noise=true , address=64.49.13.139:4469 , piece_id=N4JVCWO7ZDSQLJGWLBGDT4CYB3OD6M7HECCTDN72TLY36EJLLDAQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:53.249296097 (100h21m47.680376228s) [upload=104535]: Next returned nil segment
Aug 12 21:47:53.249315274 (100h21m47.680395405s) [upload=104535]: Waiting for error group managing segments...
Aug 12 21:47:53.546644296 (100h21m47.977724427s) [noise=true , address=64.49.13.27:4961 , piece_id=FGUMNYVMIAT4FJEGWCOTZJ35MJ346SH5OMCKZAVV6XL6WAEPVZVA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.566761076 (100h21m47.997841207s) [noise=true , address=64.49.13.139:4469 , piece_id=N4JVCWO7ZDSQLJGWLBGDT4CYB3OD6M7HECCTDN72TLY36EJLLDAQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.603354843 (100h21m48.034434974s) [noise=true , address=193.149.164.143:4698 , piece_id=SCYWXOWOCRZSG5GCHFEJTNZ3QS2ZFSPSFCZJ7TEAJAFN3PKEWJKQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.632623032 (100h21m48.063703163s) [noise=true , address=64.49.13.138:4484 , piece_id=5TFFNQAGTHJH2JDXVVLYK55FCZ7GB6G2YKJQJVDF5TF32FB6H34A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.635429241 (100h21m48.066509372s) [noise=true , address=64.49.13.170:4727 , piece_id=TKXDZCY42Y2EKAR6HCOVNK7STBD4BUKM7SQ5SJLSFVGW6IREBT6A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.999347401 (100h21m48.430427522s) [noise=true , address=79.127.220.101:4074 , piece_id=MDCOXYRY2NCY4BKILF3V6EBT267HLRITQXSLVNDPYQQRB4W3GMFA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.114236434 (100h21m48.545316565s) [noise=true , address=104.36.82.19:4403 , piece_id=5LENVCU4TRI3HNQDD42YWFSTGZAPDICMO44RZW77U7RBLFE7W65A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.114608486 (100h21m48.545688617s) [noise=true , address=104.36.82.62:4419 , piece_id=2IJB4X5NM563KUKCACHB2VFXCHIXY6FSQOCGX656C4XHPW7EOJ4A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.155891554 (100h21m48.586971685s) [noise=true , address=79.127.201.215:4356 , piece_id=EAAOPXUIEUNXRLVUHZPUGXPQ2SM6CB6N53U6YONZJKLMRKQHQRNA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.173635745 (100h21m48.604715876s) [noise=true , address=104.36.82.51:4081 , piece_id=KKKKNJ4K2WEFMU3C43IVNBZPP7MFLDCNQ6KTNNMKP5P6GLPR3O3A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.193209106 (100h21m48.624289237s) [noise=true , address=104.36.82.62:4412 , piece_id=BRACWH5HYXLUGQOS5SCLJSB3WTOHIVO4S6ETKTSCHEV6JFONVRAQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.193385403 (100h21m48.624465534s) [noise=true , address=104.36.82.59:4319 , piece_id=MKUJT373U46OC2QVSZXL33TLNPK47ZTVN74H7VBIEZVLCTOBJJCQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.372984497 (100h21m48.804064628s) [noise=true , address=104.36.82.5:4851 , piece_id=IQEMMHRRVXTBVUODNMXYDV3BE7F6TUSZISPKTW7MD42ATFPOPXVA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.420821294 (100h21m48.851901435s) [noise=true , address=104.36.82.14:4235 , piece_id=44HDKGYEW7WRGRPMHWBBO5AGY6EO5CEEMEE5EGHKIPUQMROPJULA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.420856683 (100h21m48.851936814s) [seg_pos={0 0}, upload=104535]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:47:54.421231058 (100h21m48.852311189s) [noise=true , address=104.36.82.60:4347 , piece_id=TCYRG74HEVF4R7GJ766JYIVR6SGSGKFS2WSVLNWRDBIZIBTRLHDA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: rpc: dial tcp 104.36.82.60:4347: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 21:47:54.421332483 (100h21m48.852412614s) [noise=true , address=104.36.82.23:4446 , piece_id=L6BITHHC3GU4LAZYBMCB7EAIGOGZOXIZAX4FZ5HDK3CTWDQSGHVQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: write tcp 188.166.225.170:60130->104.36.82.23:4446: use of closed network connection; write tcp 188.166.225.170:60130->104.36.82.23:4446: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60130->104.36.82.23:4446: use of closed network connection
Aug 12 21:47:54.421377599 (100h21m48.852457731s) [noise=true , address=104.36.82.36:4642 , piece_id=CMSKH3IPW3X35EVF6OB7RR75SMW2YTOX64LFVW7443JSJVU4HVSQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: read tcp 188.166.225.170:43882->104.36.82.36:4642: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 21:47:54.421401454 (100h21m48.852481605s) [noise=true , address=104.36.82.37:4656 , piece_id=TTNGCRGN7M2W77HFJZOZIV622OXAUOOS2TPUZ6PLBFWCP3EOTSXA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: read tcp 188.166.225.170:37462->104.36.82.37:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 21:47:54.421428837 (100h21m48.852508998s) [seg_pos={0 0}, upload=104535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:47:54.421505173 (100h21m48.852585304s) [upload=104535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:47:54.421511024 (100h21m48.852591155s) [upload=104535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:47:54.762214318 (100h21m49.193294489s) [upload=104535]: Done uploading segments...
Aug 12 21:47:54.762251519 (100h21m49.19333165s) [upload=104535]: Upload finished. err: <nil>
Duration: 6.044302092s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [...............X.......X.....X....X..X......X........X.....X] duration:
857.203602ms
FAIL (2025-08-12 21:48:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 21:48:04.730629622 (100h21m59.161709753s) [upload=104540]: Starting upload Aug 12 21:48:04.730680689 (100h21m59.161760821s) [upload=104540]: Done starting upload Aug 12 21:48:04.730727979 (100h21m59.1618081s) [upload=104540]: Uploading segments... Aug 12 21:48:04.730764961 (100h21m59.161845092s) [upload=104540]: Got next segment. Inline: true Aug 12 21:48:04.730768948 (100h21m59.161849079s) [upload=104540]: Waiting for error group managing segments... Aug 12 21:48:04.730801751 (100h21m59.161881882s) [upload=104540]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:48:04.730807842 (100h21m59.161887973s) [upload=104540]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:48:04.730810287 (100h21m59.161890418s) [upload=104540]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:48:04.943966318 (100h21m59.375046449s) [upload=104540]: Done uploading segments... Aug 12 21:48:04.943983691 (100h21m59.375063822s) [upload=104540]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.248098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X........................X................................X] duration:
4.2420227s
FAIL (2025-08-12 21:47:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 21:47:51.649232048 (100h21m46.080312179s) [upload=104535]: Starting upload
Aug 12 21:47:51.649295779 (100h21m46.080375911s) [upload=104535]: Done starting upload
Aug 12 21:47:51.649381253 (100h21m46.080461384s) [upload=104535]: Uploading segments...
Aug 12 21:47:51.649528165 (100h21m46.080608296s) [upload=104535]: Got next segment. Inline: false
Aug 12 21:47:51.649552431 (100h21m46.080632562s) [upload=104535]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:47:51.649557841 (100h21m46.080637962s) [upload=104535]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:47:52.110429958 (100h21m46.541510089s) [seg_pos={0 0}, upload=104535]: Begin upload segment...
Aug 12 21:47:52.110477378 (100h21m46.541557499s) [seg_pos={0 0}, upload=104535]: Done begin upload segment.
Aug 12 21:47:52.110498188 (100h21m46.541578319s) [noise=true , address=193.149.164.143:4698 , piece_id=SCYWXOWOCRZSG5GCHFEJTNZ3QS2ZFSPSFCZJ7TEAJAFN3PKEWJKQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.110547041 (100h21m46.541627172s) [noise=true , address=104.36.82.36:4642 , piece_id=CMSKH3IPW3X35EVF6OB7RR75SMW2YTOX64LFVW7443JSJVU4HVSQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.110906279 (100h21m46.54198641s) [noise=true , address=64.49.13.27:4961 , piece_id=FGUMNYVMIAT4FJEGWCOTZJ35MJ346SH5OMCKZAVV6XL6WAEPVZVA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111266628 (100h21m46.542346759s) [noise=true , address=104.36.82.59:4319 , piece_id=MKUJT373U46OC2QVSZXL33TLNPK47ZTVN74H7VBIEZVLCTOBJJCQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111336292 (100h21m46.542416423s) [noise=true , address=104.36.82.51:4081 , piece_id=KKKKNJ4K2WEFMU3C43IVNBZPP7MFLDCNQ6KTNNMKP5P6GLPR3O3A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111540592 (100h21m46.542620723s) [noise=true , address=104.36.82.62:4412 , piece_id=BRACWH5HYXLUGQOS5SCLJSB3WTOHIVO4S6ETKTSCHEV6JFONVRAQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111620936 (100h21m46.542701057s) [noise=true , address=104.36.82.60:4347 , piece_id=TCYRG74HEVF4R7GJ766JYIVR6SGSGKFS2WSVLNWRDBIZIBTRLHDA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.111834104 (100h21m46.542914225s) [noise=true , address=104.36.82.5:4851 , piece_id=IQEMMHRRVXTBVUODNMXYDV3BE7F6TUSZISPKTW7MD42ATFPOPXVA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.112148575 (100h21m46.543228696s) [noise=true , address=64.49.13.170:4727 , piece_id=TKXDZCY42Y2EKAR6HCOVNK7STBD4BUKM7SQ5SJLSFVGW6IREBT6A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.112415416 (100h21m46.543495547s) [noise=true , address=104.36.82.62:4419 , piece_id=2IJB4X5NM563KUKCACHB2VFXCHIXY6FSQOCGX656C4XHPW7EOJ4A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.112616631 (100h21m46.543696762s) [noise=true , address=104.36.82.14:4235 , piece_id=44HDKGYEW7WRGRPMHWBBO5AGY6EO5CEEMEE5EGHKIPUQMROPJULA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.112850339 (100h21m46.54393047s) [noise=true , address=104.36.82.23:4446 , piece_id=L6BITHHC3GU4LAZYBMCB7EAIGOGZOXIZAX4FZ5HDK3CTWDQSGHVQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113100978 (100h21m46.544181109s) [noise=true , address=64.49.13.138:4484 , piece_id=5TFFNQAGTHJH2JDXVVLYK55FCZ7GB6G2YKJQJVDF5TF32FB6H34A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113317673 (100h21m46.544397804s) [noise=true , address=104.36.82.37:4656 , piece_id=TTNGCRGN7M2W77HFJZOZIV622OXAUOOS2TPUZ6PLBFWCP3EOTSXA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113505943 (100h21m46.544586074s) [noise=true , address=79.127.220.101:4074 , piece_id=MDCOXYRY2NCY4BKILF3V6EBT267HLRITQXSLVNDPYQQRB4W3GMFA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113689474 (100h21m46.544769595s) [noise=true , address=79.127.201.215:4356 , piece_id=EAAOPXUIEUNXRLVUHZPUGXPQ2SM6CB6N53U6YONZJKLMRKQHQRNA, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.113897442 (100h21m46.544977573s) [noise=true , address=104.36.82.19:4403 , piece_id=5LENVCU4TRI3HNQDD42YWFSTGZAPDICMO44RZW77U7RBLFE7W65A, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:52.114085722 (100h21m46.545165853s) [noise=true , address=64.49.13.139:4469 , piece_id=N4JVCWO7ZDSQLJGWLBGDT4CYB3OD6M7HECCTDN72TLY36EJLLDAQ, seg_pos={0 0}, upload=104535]: Uploading piece...
Aug 12 21:47:53.249296097 (100h21m47.680376228s) [upload=104535]: Next returned nil segment
Aug 12 21:47:53.249315274 (100h21m47.680395405s) [upload=104535]: Waiting for error group managing segments...
Aug 12 21:47:53.546644296 (100h21m47.977724427s) [noise=true , address=64.49.13.27:4961 , piece_id=FGUMNYVMIAT4FJEGWCOTZJ35MJ346SH5OMCKZAVV6XL6WAEPVZVA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.566761076 (100h21m47.997841207s) [noise=true , address=64.49.13.139:4469 , piece_id=N4JVCWO7ZDSQLJGWLBGDT4CYB3OD6M7HECCTDN72TLY36EJLLDAQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.603354843 (100h21m48.034434974s) [noise=true , address=193.149.164.143:4698 , piece_id=SCYWXOWOCRZSG5GCHFEJTNZ3QS2ZFSPSFCZJ7TEAJAFN3PKEWJKQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.632623032 (100h21m48.063703163s) [noise=true , address=64.49.13.138:4484 , piece_id=5TFFNQAGTHJH2JDXVVLYK55FCZ7GB6G2YKJQJVDF5TF32FB6H34A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.635429241 (100h21m48.066509372s) [noise=true , address=64.49.13.170:4727 , piece_id=TKXDZCY42Y2EKAR6HCOVNK7STBD4BUKM7SQ5SJLSFVGW6IREBT6A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:53.999347401 (100h21m48.430427522s) [noise=true , address=79.127.220.101:4074 , piece_id=MDCOXYRY2NCY4BKILF3V6EBT267HLRITQXSLVNDPYQQRB4W3GMFA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.114236434 (100h21m48.545316565s) [noise=true , address=104.36.82.19:4403 , piece_id=5LENVCU4TRI3HNQDD42YWFSTGZAPDICMO44RZW77U7RBLFE7W65A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.114608486 (100h21m48.545688617s) [noise=true , address=104.36.82.62:4419 , piece_id=2IJB4X5NM563KUKCACHB2VFXCHIXY6FSQOCGX656C4XHPW7EOJ4A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.155891554 (100h21m48.586971685s) [noise=true , address=79.127.201.215:4356 , piece_id=EAAOPXUIEUNXRLVUHZPUGXPQ2SM6CB6N53U6YONZJKLMRKQHQRNA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.173635745 (100h21m48.604715876s) [noise=true , address=104.36.82.51:4081 , piece_id=KKKKNJ4K2WEFMU3C43IVNBZPP7MFLDCNQ6KTNNMKP5P6GLPR3O3A, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.193209106 (100h21m48.624289237s) [noise=true , address=104.36.82.62:4412 , piece_id=BRACWH5HYXLUGQOS5SCLJSB3WTOHIVO4S6ETKTSCHEV6JFONVRAQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.193385403 (100h21m48.624465534s) [noise=true , address=104.36.82.59:4319 , piece_id=MKUJT373U46OC2QVSZXL33TLNPK47ZTVN74H7VBIEZVLCTOBJJCQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.372984497 (100h21m48.804064628s) [noise=true , address=104.36.82.5:4851 , piece_id=IQEMMHRRVXTBVUODNMXYDV3BE7F6TUSZISPKTW7MD42ATFPOPXVA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.420821294 (100h21m48.851901435s) [noise=true , address=104.36.82.14:4235 , piece_id=44HDKGYEW7WRGRPMHWBBO5AGY6EO5CEEMEE5EGHKIPUQMROPJULA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: <nil>
Aug 12 21:47:54.420856683 (100h21m48.851936814s) [seg_pos={0 0}, upload=104535]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:47:54.421231058 (100h21m48.852311189s) [noise=true , address=104.36.82.60:4347 , piece_id=TCYRG74HEVF4R7GJ766JYIVR6SGSGKFS2WSVLNWRDBIZIBTRLHDA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM): protocol: rpc: dial tcp 104.36.82.60:4347: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 21:47:54.421332483 (100h21m48.852412614s) [noise=true , address=104.36.82.23:4446 , piece_id=L6BITHHC3GU4LAZYBMCB7EAIGOGZOXIZAX4FZ5HDK3CTWDQSGHVQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: write tcp 188.166.225.170:60130->104.36.82.23:4446: use of closed network connection; write tcp 188.166.225.170:60130->104.36.82.23:4446: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60130->104.36.82.23:4446: use of closed network connection
Aug 12 21:47:54.421377599 (100h21m48.852457731s) [noise=true , address=104.36.82.36:4642 , piece_id=CMSKH3IPW3X35EVF6OB7RR75SMW2YTOX64LFVW7443JSJVU4HVSQ, seg_pos={0 0}, upload=104535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127tVQUAwStYLonZ1jjq2tjtuqbLpKh593Uj1yyhGPy5XQ5AF5L): protocol: read tcp 188.166.225.170:43882->104.36.82.36:4642: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 21:47:54.421401454 (100h21m48.852481605s) [noise=true , address=104.36.82.37:4656 , piece_id=TTNGCRGN7M2W77HFJZOZIV622OXAUOOS2TPUZ6PLBFWCP3EOTSXA, seg_pos={0 0}, upload=104535]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6e2ZjrPg2q3EDN2ZjDj9hzEmCAoRvt39HMeM79gcVmMVm53j): protocol: read tcp 188.166.225.170:37462->104.36.82.37:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 21:47:54.421428837 (100h21m48.852508998s) [seg_pos={0 0}, upload=104535]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:47:54.421505173 (100h21m48.852585304s) [upload=104535]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:47:54.421511024 (100h21m48.852591155s) [upload=104535]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:47:54.762214318 (100h21m49.193294489s) [upload=104535]: Done uploading segments...
Aug 12 21:47:54.762251519 (100h21m49.19333165s) [upload=104535]: Upload finished. err: <nil>
Duration: 4.242039844s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
639.42626ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:47:46 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 639.449596ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
646.311934ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:47:17 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 646.339929ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X........................X................................] duration:
6.018243133s
FAIL (2025-08-12 21:46:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 6.018270977s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [................X.......X.....X....X..X......X........X.....] duration:
1.818135293s
FAIL (2025-08-12 21:46:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 12 21:43:02.649208364 (100h16m57.080288536s) [upload=104454]: Starting upload Aug 12 21:43:02.649277967 (100h16m57.080358098s) [upload=104454]: Done starting upload Aug 12 21:43:02.649348613 (100h16m57.080428744s) [upload=104454]: Uploading segments... Aug 12 21:43:02.649393188 (100h16m57.080473329s) [upload=104454]: Got next segment. Inline: true Aug 12 21:43:02.649398829 (100h16m57.08047896s) [upload=104454]: Waiting for error group managing segments... Aug 12 21:43:02.649447673 (100h16m57.080527804s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:43:02.649453353 (100h16m57.080533494s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:43:02.649457271 (100h16m57.080537412s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:43:03.175712717 (100h16m57.606792838s) [upload=104454]: Done uploading segments... Aug 12 21:43:03.175733607 (100h16m57.606813738s) [upload=104454]: Upload finished. err: <nil>
Duration: 1.818171522s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X........................X...............................] duration:
5.89557529s
FAIL (2025-08-12 21:46:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 5.895603755s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
648.881364ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:46:29 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 648.906291ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X........................X..............................] duration:
5.955758397s
FAIL (2025-08-12 21:45:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 5.955862276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.................X.......X.....X....X..X......X........X....] duration:
1.858492198s
FAIL (2025-08-12 21:45:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 12 21:43:02.649208364 (100h16m57.080288536s) [upload=104454]: Starting upload Aug 12 21:43:02.649277967 (100h16m57.080358098s) [upload=104454]: Done starting upload Aug 12 21:43:02.649348613 (100h16m57.080428744s) [upload=104454]: Uploading segments... Aug 12 21:43:02.649393188 (100h16m57.080473329s) [upload=104454]: Got next segment. Inline: true Aug 12 21:43:02.649398829 (100h16m57.08047896s) [upload=104454]: Waiting for error group managing segments... Aug 12 21:43:02.649447673 (100h16m57.080527804s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:43:02.649453353 (100h16m57.080533494s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:43:02.649457271 (100h16m57.080537412s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:43:03.175712717 (100h16m57.606792838s) [upload=104454]: Done uploading segments... Aug 12 21:43:03.175733607 (100h16m57.606813738s) [upload=104454]: Upload finished. err: <nil>
Duration: 1.858534118s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
645.54632ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:45:29 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 645.571549ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
651.367378ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:44:50 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 651.390613ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..................X.......X.....X....X..X......X........X...] duration:
1.839649307s
FAIL (2025-08-12 21:44:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 12 21:43:02.649208364 (100h16m57.080288536s) [upload=104454]: Starting upload Aug 12 21:43:02.649277967 (100h16m57.080358098s) [upload=104454]: Done starting upload Aug 12 21:43:02.649348613 (100h16m57.080428744s) [upload=104454]: Uploading segments... Aug 12 21:43:02.649393188 (100h16m57.080473329s) [upload=104454]: Got next segment. Inline: true Aug 12 21:43:02.649398829 (100h16m57.08047896s) [upload=104454]: Waiting for error group managing segments... Aug 12 21:43:02.649447673 (100h16m57.080527804s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:43:02.649453353 (100h16m57.080533494s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:43:02.649457271 (100h16m57.080537412s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:43:03.175712717 (100h16m57.606792838s) [upload=104454]: Done uploading segments... Aug 12 21:43:03.175733607 (100h16m57.606813738s) [upload=104454]: Upload finished. err: <nil>
Duration: 1.839682521s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X........................X.............................] duration:
5.97419669s
FAIL (2025-08-12 21:44:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 5.974226566s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...................X.......X.....X....X..X......X........X..] duration:
1.890884318s
FAIL (2025-08-12 21:44:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 12 21:43:02.649208364 (100h16m57.080288536s) [upload=104454]: Starting upload Aug 12 21:43:02.649277967 (100h16m57.080358098s) [upload=104454]: Done starting upload Aug 12 21:43:02.649348613 (100h16m57.080428744s) [upload=104454]: Uploading segments... Aug 12 21:43:02.649393188 (100h16m57.080473329s) [upload=104454]: Got next segment. Inline: true Aug 12 21:43:02.649398829 (100h16m57.08047896s) [upload=104454]: Waiting for error group managing segments... Aug 12 21:43:02.649447673 (100h16m57.080527804s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:43:02.649453353 (100h16m57.080533494s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:43:02.649457271 (100h16m57.080537412s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:43:03.175712717 (100h16m57.606792838s) [upload=104454]: Done uploading segments... Aug 12 21:43:03.175733607 (100h16m57.606813738s) [upload=104454]: Upload finished. err: <nil>
Duration: 1.890914916s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
644.334301ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:44:27 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 644.363448ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
651.802551ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:44:12 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 651.84942ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X........................X............................] duration:
7.039642367s
FAIL (2025-08-12 21:44:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 7.039667717s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X........................X...........................] duration:
6.021673755s
FAIL (2025-08-12 21:43:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 6.021700738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....................X.......X.....X....X..X......X........X.] duration:
1.846517076s
FAIL (2025-08-12 21:43:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 12 21:43:02.649208364 (100h16m57.080288536s) [upload=104454]: Starting upload Aug 12 21:43:02.649277967 (100h16m57.080358098s) [upload=104454]: Done starting upload Aug 12 21:43:02.649348613 (100h16m57.080428744s) [upload=104454]: Uploading segments... Aug 12 21:43:02.649393188 (100h16m57.080473329s) [upload=104454]: Got next segment. Inline: true Aug 12 21:43:02.649398829 (100h16m57.08047896s) [upload=104454]: Waiting for error group managing segments... Aug 12 21:43:02.649447673 (100h16m57.080527804s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:43:02.649453353 (100h16m57.080533494s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:43:02.649457271 (100h16m57.080537412s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:43:03.175712717 (100h16m57.606792838s) [upload=104454]: Done uploading segments... Aug 12 21:43:03.175733607 (100h16m57.606813738s) [upload=104454]: Upload finished. err: <nil>
Duration: 1.846548375s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X........................X..........................] duration:
6.475748799s
FAIL (2025-08-12 21:43:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 6.475776742s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
653.669823ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:43:14 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 653.692647ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.....................X.......X.....X....X..X......X........X] duration:
1.964656007s
FAIL (2025-08-12 21:43:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 12 21:43:02.649208364 (100h16m57.080288536s) [upload=104454]: Starting upload Aug 12 21:43:02.649277967 (100h16m57.080358098s) [upload=104454]: Done starting upload Aug 12 21:43:02.649348613 (100h16m57.080428744s) [upload=104454]: Uploading segments... Aug 12 21:43:02.649393188 (100h16m57.080473329s) [upload=104454]: Got next segment. Inline: true Aug 12 21:43:02.649398829 (100h16m57.08047896s) [upload=104454]: Waiting for error group managing segments... Aug 12 21:43:02.649447673 (100h16m57.080527804s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:43:02.649453353 (100h16m57.080533494s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:43:02.649457271 (100h16m57.080537412s) [upload=104454]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:43:03.175712717 (100h16m57.606792838s) [upload=104454]: Done uploading segments... Aug 12 21:43:03.175733607 (100h16m57.606813738s) [upload=104454]: Upload finished. err: <nil>
Duration: 1.964690823s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
651.737666ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:42:53 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 651.76102ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X........................X.........................] duration:
14.513153529s
FAIL (2025-08-12 21:42:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 14.513182756s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
655.287027ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:42:38 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 655.314712ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......................X.......X.....X....X..X......X........] duration:
2.019471217s
FAIL (2025-08-12 21:42:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 21:36:20.417668904 (100h10m14.848749035s) [upload=104341]: Starting upload Aug 12 21:36:20.417716826 (100h10m14.848796957s) [upload=104341]: Done starting upload Aug 12 21:36:20.417763645 (100h10m14.848843776s) [upload=104341]: Uploading segments... Aug 12 21:36:20.417940855 (100h10m14.849020976s) [upload=104341]: Got next segment. Inline: true Aug 12 21:36:20.417946716 (100h10m14.849026847s) [upload=104341]: Waiting for error group managing segments... Aug 12 21:36:20.417994447 (100h10m14.849074578s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:36:20.417998635 (100h10m14.849078766s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:36:20.418001290 (100h10m14.849081411s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:36:20.630260475 (100h10m15.061340606s) [upload=104341]: Done uploading segments... Aug 12 21:36:20.630277557 (100h10m15.061357688s) [upload=104341]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.019532745s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X........................X........................] duration:
6.167028513s
FAIL (2025-08-12 21:42:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 6.167049293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X........................X.......................] duration:
5.655348309s
FAIL (2025-08-12 21:41:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 5.655367498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......................X.......X.....X....X..X......X.......] duration:
1.867016039s
FAIL (2025-08-12 21:41:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 21:36:20.417668904 (100h10m14.848749035s) [upload=104341]: Starting upload Aug 12 21:36:20.417716826 (100h10m14.848796957s) [upload=104341]: Done starting upload Aug 12 21:36:20.417763645 (100h10m14.848843776s) [upload=104341]: Uploading segments... Aug 12 21:36:20.417940855 (100h10m14.849020976s) [upload=104341]: Got next segment. Inline: true Aug 12 21:36:20.417946716 (100h10m14.849026847s) [upload=104341]: Waiting for error group managing segments... Aug 12 21:36:20.417994447 (100h10m14.849074578s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:36:20.417998635 (100h10m14.849078766s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:36:20.418001290 (100h10m14.849081411s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:36:20.630260475 (100h10m15.061340606s) [upload=104341]: Done uploading segments... Aug 12 21:36:20.630277557 (100h10m15.061357688s) [upload=104341]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.867041136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
650.375861ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:41:33 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 650.403164ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X........................X......................] duration:
5.74900103s
FAIL (2025-08-12 21:41:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 5.749028282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
647.251703ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:40:57 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 647.280458ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X........................X.....................] duration:
6.422829353s
FAIL (2025-08-12 21:40:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 6.42285354s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........................X.......X.....X....X..X......X......] duration:
1.862484526s
FAIL (2025-08-12 21:40:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 21:36:20.417668904 (100h10m14.848749035s) [upload=104341]: Starting upload Aug 12 21:36:20.417716826 (100h10m14.848796957s) [upload=104341]: Done starting upload Aug 12 21:36:20.417763645 (100h10m14.848843776s) [upload=104341]: Uploading segments... Aug 12 21:36:20.417940855 (100h10m14.849020976s) [upload=104341]: Got next segment. Inline: true Aug 12 21:36:20.417946716 (100h10m14.849026847s) [upload=104341]: Waiting for error group managing segments... Aug 12 21:36:20.417994447 (100h10m14.849074578s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:36:20.417998635 (100h10m14.849078766s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:36:20.418001290 (100h10m14.849081411s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:36:20.630260475 (100h10m15.061340606s) [upload=104341]: Done uploading segments... Aug 12 21:36:20.630277557 (100h10m15.061357688s) [upload=104341]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.862523851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X........................X....................] duration:
5.72908219s
FAIL (2025-08-12 21:39:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 5.729104183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........................X.......X.....X....X..X......X.....] duration:
2.547604619s
FAIL (2025-08-12 21:39:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 21:36:20.417668904 (100h10m14.848749035s) [upload=104341]: Starting upload Aug 12 21:36:20.417716826 (100h10m14.848796957s) [upload=104341]: Done starting upload Aug 12 21:36:20.417763645 (100h10m14.848843776s) [upload=104341]: Uploading segments... Aug 12 21:36:20.417940855 (100h10m14.849020976s) [upload=104341]: Got next segment. Inline: true Aug 12 21:36:20.417946716 (100h10m14.849026847s) [upload=104341]: Waiting for error group managing segments... Aug 12 21:36:20.417994447 (100h10m14.849074578s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:36:20.417998635 (100h10m14.849078766s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:36:20.418001290 (100h10m14.849081411s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:36:20.630260475 (100h10m15.061340606s) [upload=104341]: Done uploading segments... Aug 12 21:36:20.630277557 (100h10m15.061357688s) [upload=104341]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.547634786s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
651.78613ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:39:45 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 651.803382ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........................X.......X.....X....X..X......X....] duration:
1.893512096s
FAIL (2025-08-12 21:39:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 21:36:20.417668904 (100h10m14.848749035s) [upload=104341]: Starting upload Aug 12 21:36:20.417716826 (100h10m14.848796957s) [upload=104341]: Done starting upload Aug 12 21:36:20.417763645 (100h10m14.848843776s) [upload=104341]: Uploading segments... Aug 12 21:36:20.417940855 (100h10m14.849020976s) [upload=104341]: Got next segment. Inline: true Aug 12 21:36:20.417946716 (100h10m14.849026847s) [upload=104341]: Waiting for error group managing segments... Aug 12 21:36:20.417994447 (100h10m14.849074578s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:36:20.417998635 (100h10m14.849078766s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:36:20.418001290 (100h10m14.849081411s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:36:20.630260475 (100h10m15.061340606s) [upload=104341]: Done uploading segments... Aug 12 21:36:20.630277557 (100h10m15.061357688s) [upload=104341]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.893536793s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X........................X...................] duration:
6.067950955s
FAIL (2025-08-12 21:38:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 6.068070844s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
644.483608ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:38:51 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 644.512513ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........................X.......X.....X....X..X......X...] duration:
1.875320558s
FAIL (2025-08-12 21:38:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 21:36:20.417668904 (100h10m14.848749035s) [upload=104341]: Starting upload Aug 12 21:36:20.417716826 (100h10m14.848796957s) [upload=104341]: Done starting upload Aug 12 21:36:20.417763645 (100h10m14.848843776s) [upload=104341]: Uploading segments... Aug 12 21:36:20.417940855 (100h10m14.849020976s) [upload=104341]: Got next segment. Inline: true Aug 12 21:36:20.417946716 (100h10m14.849026847s) [upload=104341]: Waiting for error group managing segments... Aug 12 21:36:20.417994447 (100h10m14.849074578s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:36:20.417998635 (100h10m14.849078766s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:36:20.418001290 (100h10m14.849081411s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:36:20.630260475 (100h10m15.061340606s) [upload=104341]: Done uploading segments... Aug 12 21:36:20.630277557 (100h10m15.061357688s) [upload=104341]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.875344312s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X........................X..................] duration:
5.869222978s
FAIL (2025-08-12 21:38:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 5.869242545s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............................X.......X.....X....X..X......X..] duration:
1.893247065s
FAIL (2025-08-12 21:37:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 21:36:20.417668904 (100h10m14.848749035s) [upload=104341]: Starting upload Aug 12 21:36:20.417716826 (100h10m14.848796957s) [upload=104341]: Done starting upload Aug 12 21:36:20.417763645 (100h10m14.848843776s) [upload=104341]: Uploading segments... Aug 12 21:36:20.417940855 (100h10m14.849020976s) [upload=104341]: Got next segment. Inline: true Aug 12 21:36:20.417946716 (100h10m14.849026847s) [upload=104341]: Waiting for error group managing segments... Aug 12 21:36:20.417994447 (100h10m14.849074578s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:36:20.417998635 (100h10m14.849078766s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:36:20.418001290 (100h10m14.849081411s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:36:20.630260475 (100h10m15.061340606s) [upload=104341]: Done uploading segments... Aug 12 21:36:20.630277557 (100h10m15.061357688s) [upload=104341]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.893269118s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X........................X.................] duration:
6.051393085s
FAIL (2025-08-12 21:37:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 6.051418323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
652.305555ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:37:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 652.331704ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.............................X.......X.....X....X..X......X.] duration:
2.001109536s
FAIL (2025-08-12 21:37:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 21:36:20.417668904 (100h10m14.848749035s) [upload=104341]: Starting upload Aug 12 21:36:20.417716826 (100h10m14.848796957s) [upload=104341]: Done starting upload Aug 12 21:36:20.417763645 (100h10m14.848843776s) [upload=104341]: Uploading segments... Aug 12 21:36:20.417940855 (100h10m14.849020976s) [upload=104341]: Got next segment. Inline: true Aug 12 21:36:20.417946716 (100h10m14.849026847s) [upload=104341]: Waiting for error group managing segments... Aug 12 21:36:20.417994447 (100h10m14.849074578s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 21:36:20.417998635 (100h10m14.849078766s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 21:36:20.418001290 (100h10m14.849081411s) [upload=104341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 21:36:20.630260475 (100h10m15.061340606s) [upload=104341]: Done uploading segments... Aug 12 21:36:20.630277557 (100h10m15.061357688s) [upload=104341]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.001136067s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X........................X................] duration:
6.001901659s
FAIL (2025-08-12 21:37:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1f07da8bebf22a69670fe43984597bde7eb5307b3a41023b3f51c2a38bf378ff != before fbe11063fb80f63ac5100e40c19f18c8713bdbdc69948ac885867f911e512665
======LOGS======
Aug 12 21:23:52.923100975 (99h57m47.354181106s) [upload=104127]: Starting upload
Aug 12 21:23:52.923149728 (99h57m47.354229849s) [upload=104127]: Done starting upload
Aug 12 21:23:52.923203832 (99h57m47.354283963s) [upload=104127]: Uploading segments...
Aug 12 21:23:52.923344661 (99h57m47.354424792s) [upload=104127]: Got next segment. Inline: false
Aug 12 21:23:52.923373657 (99h57m47.354453788s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 21:23:52.923379468 (99h57m47.354459599s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 21:23:53.370058317 (99h57m47.801138448s) [seg_pos={0 0}, upload=104127]: Begin upload segment...
Aug 12 21:23:53.370100318 (99h57m47.801180449s) [seg_pos={0 0}, upload=104127]: Done begin upload segment.
Aug 12 21:23:53.370124284 (99h57m47.801204405s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370133772 (99h57m47.801213913s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370478943 (99h57m47.801559074s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370749259 (99h57m47.80182939s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.370838430 (99h57m47.801918561s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371009688 (99h57m47.802089809s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371252512 (99h57m47.802332644s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371355138 (99h57m47.802435279s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371471752 (99h57m47.802551883s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371693606 (99h57m47.802773737s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371781184 (99h57m47.802861325s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.371937183 (99h57m47.803017314s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372234320 (99h57m47.803314451s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372433462 (99h57m47.803513593s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372628996 (99h57m47.803709127s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.372817627 (99h57m47.803897748s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373015145 (99h57m47.804095276s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:53.373205800 (99h57m47.804285931s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Uploading piece...
Aug 12 21:23:54.491188361 (99h57m48.922268492s) [upload=104127]: Next returned nil segment
Aug 12 21:23:54.491207348 (99h57m48.922287469s) [upload=104127]: Waiting for error group managing segments...
Aug 12 21:23:54.777102342 (99h57m49.208182473s) [noise=true , address=64.49.13.140:4513 , piece_id=XBCC6BL27VV7Z4GYLY2ASJ2SB36W5D5MA2JSCJYGB5Z5ZTXHYUNQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.316456400 (99h57m49.747536531s) [noise=true , address=77.90.31.15:4722 , piece_id=QFPPSKTF5IEKUIPM4QDTM6DTSXXNV3N7RZYS2MSRFOXSPAIM6GCQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.317136562 (99h57m49.748216693s) [noise=true , address=45.91.116.12:4236 , piece_id=KC64A6BHXVUJV6APZ66AUL3YII6NKXQ6A5CGTI3BHZ6DNLEGFZHA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.350492733 (99h57m49.781572864s) [noise=true , address=104.36.82.17:4345 , piece_id=ZK6R75VARJCTRQ3EZUZWLFH5Z2LH6J337AA5KGLL6EVIX5FSIW6Q, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367245597 (99h57m49.798325728s) [noise=true , address=104.36.82.35:4604 , piece_id=KZBBDDG2UDN22HBWYWTGRKJX3SDSSQJYA6YZYSDKRFVJSJP4JWRQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.367508531 (99h57m49.798588662s) [noise=true , address=104.36.82.20:4451 , piece_id=LR6YPBIO3H4PBPW6JJ6GPKVGPCVO3OMAYW3UY3OTDGC4F7XZIJPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.381938790 (99h57m49.813018921s) [noise=true , address=77.90.31.11:4583 , piece_id=PCJBH5KRTW7SSLARY3CPMK65XWMCTYVBNWVJ7RNEKUS6QPFW2ASQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.390618227 (99h57m49.821698368s) [noise=true , address=104.36.82.39:4753 , piece_id=AHBV7DD454NPO3KXFUAGG4ASXWYUF3AFUG3L5W4T3FWZXJZ6SISA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.392642571 (99h57m49.823722712s) [noise=true , address=104.36.82.14:4244 , piece_id=VZNXD5M7GVJ3LIAGLDBWUVQFIDRJFFYKOOEG5RBHNSCXXJTCVFKA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.401283514 (99h57m49.832363645s) [noise=true , address=104.36.82.39:4735 , piece_id=23QUOA3WCGCEEROB7LTADBCAR5UMMGG36QQ36D2OCTBA6QZV4HPA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.430675701 (99h57m49.861755822s) [noise=true , address=104.36.82.9:4023 , piece_id=LBBR44W3QW46VAURRZZXQIOHCR54XFMABXWHSDAMOTDIEUWJ4R2A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454603994 (99h57m49.885684125s) [noise=true , address=104.36.82.51:4068 , piece_id=HPDYN2BYODFOGUAKHO47YFSWW36DHU24IA5XQHZX77BUV5GQ2Y6A, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.454722170 (99h57m49.885802301s) [noise=true , address=104.36.82.23:4458 , piece_id=2NG6TN7V3X3EDR3VIJLMOWOTUCPBT26RK2KPQUQ6K522ZEIP5ZZQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469851568 (99h57m49.900931699s) [noise=true , address=104.36.82.45:4916 , piece_id=D67NMKTEBZLBCEBX4G66E5AHFU6DRPTY7YP5IIXMGXSBLQBYURLA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: <nil>
Aug 12 21:23:55.469881675 (99h57m49.900961836s) [seg_pos={0 0}, upload=104127]: Segment reached optimal threshold of 14 pieces.
Aug 12 21:23:55.470041100 (99h57m49.901121231s) [noise=true , address=104.36.82.43:4836 , piece_id=OFKWWI3VOSBGOAEKUABDRV5ZQDQFLI2I5ZULBKSQQC25WKLZ2HUQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470097338 (99h57m49.901177459s) [noise=true , address=45.91.116.9:4266 , piece_id=WPYVTHMRC3SKPBT3GI3ZSIKNKWEI2L743H5ZXG5T7DD7HFWSCJZA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122haq5d2WbTqtApFTxZCfjyTxcJN1fEjThxqefURqiPGXFXA3k): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470282613 (99h57m49.901362774s) [noise=true , address=104.36.82.38:4709 , piece_id=YGSVDJGJ7DZFHECDU4KFUVTKBZ473BKA6JW2WK6JTFWWDJ6DO7IA, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ad77dgyCKuYL8o9Ac1WrMfk7pG1mgkakcVXwZa2QHD6KG5sdH): protocol: expected piece hash; context canceled; EOF
Aug 12 21:23:55.470339662 (99h57m49.901419793s) [noise=true , address=104.36.82.46:4496 , piece_id=5XLC54O7E33GBS4K5UYJ2Y6RBI5VTZFKKRJUCDHXFTWPK4XNUEQQ, seg_pos={0 0}, upload=104127]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59870->104.36.82.46:4496: use of closed network connection
Aug 12 21:23:55.470357405 (99h57m49.901437536s) [seg_pos={0 0}, upload=104127]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 21:23:55.470441065 (99h57m49.901521196s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 21:23:55.470448600 (99h57m49.901528761s) [upload=104127]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 21:23:55.801072487 (99h57m50.232152619s) [upload=104127]: Done uploading segments...
Aug 12 21:23:55.801091824 (99h57m50.232171955s) [upload=104127]: Upload finished. err: <nil>
Duration: 6.001927238s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
652.728713ms target:
https://us1.storj.io/login
FAIL (2025-08-12 21:37:08 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused
Duration: 652.764512ms
core
satellite
us1
|