Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.703351914s
FAIL (2025-07-14 04:39:50 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.703374546s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.658315674s
FAIL (2025-07-14 04:39:07 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.658364818s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.823647297s
FAIL (2025-07-14 04:38:42 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.823675311s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.778547428s
FAIL (2025-07-14 04:37:43 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.778574539s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.669163007s
FAIL (2025-07-14 04:37:14 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.669190038s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.805143358s
FAIL (2025-07-14 04:36:20 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.805173306s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.615581257s
FAIL (2025-07-14 04:35:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.615612517s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.673220568s
FAIL (2025-07-14 04:35:05 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.673251268s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.686223223s
FAIL (2025-07-14 04:33:54 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.686250444s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.654113843s
FAIL (2025-07-14 04:33:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.654156676s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.750646786s
FAIL (2025-07-14 04:32:50 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.750682674s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.680567803s
FAIL (2025-07-14 04:32:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.680597749s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.625291713s
FAIL (2025-07-14 04:31:58 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.625315778s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.747176237s
FAIL (2025-07-14 04:31:10 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.747207106s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.670954321s
FAIL (2025-07-14 04:30:00 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.67098469s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.780731854s
FAIL (2025-07-14 04:29:38 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.780805134s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.688611733s
FAIL (2025-07-14 04:28:43 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.688637513s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.640745258s
FAIL (2025-07-14 04:27:43 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.640837154s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.80316507s
FAIL (2025-07-14 04:27:04 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.803190298s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.733395111s
FAIL (2025-07-14 04:25:51 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.733423556s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.673838806s
FAIL (2025-07-14 04:24:57 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.673863232s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
20.96124345s
FAIL (2025-07-14 04:24:14 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 20.961268418s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.919506079s
FAIL (2025-07-14 04:22:45 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 5.919532439s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002005451s
FAIL (2025-07-14 04:22:22 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
756798231 (499h11m13.527439556s) [noise=true , address=104.36.82.13:4187 , piece_id=VVIE6JF3X4ORC6MYTPEWMVZVS6LFEGGGMIHXAMXA5LKPHW7XPJWQ, seg_pos={0 0}, upload=399340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:38.756808310 (499h11m13.527449645s) [seg_pos={0 0}, upload=399340]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:38.756871231 (499h11m13.527512556s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:38.756874778 (499h11m13.527516113s) [upload=399340]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:39.033580138 (499h11m13.804221473s) [upload=399340]: Done uploading segments...
Jul 14 04:21:39.033598373 (499h11m13.804239708s) [upload=399340]: Upload finished. err: <nil>
Jul 14 04:21:53.044271806 (499h11m27.814913141s) [upload=399344]: Starting upload
Jul 14 04:21:53.044327973 (499h11m27.814969308s) [upload=399344]: Done starting upload
Jul 14 04:21:53.044561159 (499h11m27.815202494s) [upload=399344]: Uploading segments...
Jul 14 04:21:53.044599393 (499h11m27.815240738s) [upload=399344]: Got next segment. Inline: false
Jul 14 04:21:53.044640220 (499h11m27.815281545s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 04:21:53.044649709 (499h11m27.815291044s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 04:21:53.300513655 (499h11m28.07115499s) [seg_pos={0 0}, upload=399344]: Begin upload segment...
Jul 14 04:21:53.300565524 (499h11m28.07120686s) [seg_pos={0 0}, upload=399344]: Done begin upload segment.
Jul 14 04:21:53.300587537 (499h11m28.071228862s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.300961964 (499h11m28.071603299s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301251186 (499h11m28.071892521s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301528908 (499h11m28.072170243s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.301556971 (499h11m28.072198296s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302571883 (499h11m28.073213218s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.302825218 (499h11m28.073466553s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.303709780 (499h11m28.074351115s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304058588 (499h11m28.074699923s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304338032 (499h11m28.074979367s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304535911 (499h11m28.075177246s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304776491 (499h11m28.075417826s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.304970643 (499h11m28.075611978s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305172719 (499h11m28.075814054s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305366910 (499h11m28.076008245s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:53.305635454 (499h11m28.076276789s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Uploading piece...
Jul 14 04:21:55.051918919 (499h11m29.822560254s) [upload=399344]: Next returned nil segment
Jul 14 04:21:55.051935832 (499h11m29.822577167s) [upload=399344]: Waiting for error group managing segments...
Jul 14 04:21:55.333869054 (499h11m30.104510389s) [noise=true , address=104.36.82.14:4223 , piece_id=EVEUCNFEDDO5N72OEMSGY23VOLHBQOKPJTY5E6YGLLVTESWKDKVA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344232682 (499h11m30.114874027s) [noise=true , address=45.91.116.7:4011 , piece_id=JII2REIGJDRI7AZ73TJCQWKG76AE2PYKFF6NKMYBGQWZQOG6RIAA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.344526543 (499h11m30.115167898s) [noise=true , address=104.36.82.8:4969 , piece_id=4F2NFG4CFZA4JV7KPESMC5OXUU2K3ZVBTO3CDGW43VASF2EUYMXA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.350066693 (499h11m30.120708028s) [noise=true , address=104.36.82.6:4874 , piece_id=ZFMXQCWJG6FT4HOCH5ZNBMEBEGKC6E6OQX5NMYZKVVA3Y5MUG53Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.365920003 (499h11m30.136561338s) [noise=true , address=45.91.116.10:4082 , piece_id=RFYTHWZ4ANHR7VGJIIF73FUD35VSPBAJLQ7GPKKK2G5T2CAICHUA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.384095677 (499h11m30.154737012s) [noise=true , address=77.90.31.12:4590 , piece_id=Z4RV6YUKMXGX6QSVPN6EID7IHOCF7HYZQCF5DMW6AXFTMOEQVV4A, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.393125213 (499h11m30.163766548s) [noise=true , address=77.90.31.15:4698 , piece_id=OW7OSNYMHYFZYBA6CR2O5JIENBD2ZCRCL667BM4FIFI2LOXK6FPQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.400699914 (499h11m30.171341249s) [noise=true , address=77.90.31.14:4662 , piece_id=4MSPCZCGSKYCLMXCFG6G7IM25Q3VTN5G3Q6ZNRAPT7QBJO3N3YMQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.402507863 (499h11m30.173149198s) [noise=true , address=77.90.31.17:4770 , piece_id=GXBKX6UM3TA5DRYZ4MLSVR7D6Z3ORJX6ZC6ON64JQ2I675JVWOJA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.403177154 (499h11m30.173818499s) [noise=true , address=77.90.31.18:4806 , piece_id=NBILQ7G3FJMQI2LILQKBKERVHRQHHJZ5C5BHM5FQTO3GDS7426NA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.477025570 (499h11m30.247666905s) [noise=true , address=104.36.82.3:4767 , piece_id=AR6VFW2YJCAKGGHTAXXFMF63CHOKCWKQYHFGBRDCCLZCIRAEB23Q, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.487037124 (499h11m30.257678459s) [noise=true , address=104.36.82.9:4005 , piece_id=4RTBXFTRNINKUVS6P3Y2ISNWGSOVU3RXNUFCMIMFTWLSXZ52TYIA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494226308 (499h11m30.264867643s) [noise=true , address=104.36.82.15:4257 , piece_id=DUOZJ4UDODTAT5PZ4AKKOYOWDM6GRS3MMKJ76PP6QC4ZHM4PGPGQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: <nil>
Jul 14 04:21:55.494249252 (499h11m30.264890587s) [seg_pos={0 0}, upload=399344]: Segment reached optimal threshold of 13 pieces.
Jul 14 04:21:55.494390602 (499h11m30.265031947s) [noise=true , address=45.91.116.11:4119 , piece_id=5G4GR52NP4JRQUEKF7AD6HIXPROCI322ANNE4RY2ONGR2WQSNGYA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494463572 (499h11m30.265104907s) [noise=true , address=45.91.116.5:4299 , piece_id=VA5F5YFD7TT7WF5YXCXVSGRBMFX67JYCZ5ZBRFDGWYNDKBTSJBGA, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494509059 (499h11m30.265150394s) [noise=true , address=45.91.116.13:4154 , piece_id=LW4I3KIGUPTKNXZKCVKF4QLKRXSSEHQMR4ELW3ZKH3DWNJ5YYTJQ, seg_pos={0 0}, upload=399344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 14 04:21:55.494549967 (499h11m30.265191302s) [seg_pos={0 0}, upload=399344]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 04:21:55.494615784 (499h11m30.265257119s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 04:21:55.494620392 (499h11m30.265261727s) [upload=399344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 04:21:55.784110932 (499h11m30.554752267s) [upload=399344]: Done uploading segments...
Jul 14 04:21:55.784130360 (499h11m30.554771695s) [upload=399344]: Upload finished. err: <nil>
Duration: 30.002019299s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
857.107097ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:36:23 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 857.131104ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
894.413448ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:36:01 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 894.438267ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
867.305946ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:35:18 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 867.330373ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
903.963188ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:34:24 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 903.986582ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
945.820324ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:33:41 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 945.84449ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
876.20394ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:33:02 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 876.23052ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
902.849547ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:32:42 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 902.873132ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.313390128s remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:31:46 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.313420474s
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
896.549312ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:31:14 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 896.571053ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
930.616157ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:30:22 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 930.643811ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
885.656069ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:30:06 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 885.684423ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.176041746s remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:29:35 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 1.176062135s
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
897.456185ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:28:43 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 897.478257ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
872.908944ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:28:23 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 872.934942ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
894.690901ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:28:06 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 894.716841ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
934.1216ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:26:58 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 934.148272ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
867.179023ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:26:09 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 867.203228ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
876.125236ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:25:28 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 876.157348ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
924.918514ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:24:45 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 924.948041ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
896.503946ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:23:41 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 896.527161ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
887.890057ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:22:57 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 887.917351ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
879.413141ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:22:33 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 879.431496ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
893.696624ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:21:46 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 893.735728ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
925.068413ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:20:34 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 925.095095ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
875.373474ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:19:43 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 875.426787ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
892.263002ms remote:
"tcp:5.161.37.179:443" response headers:
Content-Type=text/plain; charset=utf-8 Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 22:55:22 GMT Content-Length=11 target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 23:18:40 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 892.283642ms
edge
ipfs
us1
|