[libtorrent] libtorrent with python binding hangs sometimes

[Jeong Woo Seo]

Hi all.

I built centralized patch system with libtorrent and python. All clients are linux and have different kernel version.
Clients with above kernel 3.19 sometimes hang when download torrents.

When i tried to kill python process, it turned to zombie. OS is Ubuntu 14.04 LTS and filesystem is NTFS-3G.

I attached /proc/pid/stack log.

***@bong-M:~# cat /proc/2963/stack
[<ffffffff812e03c9>] jbd2_log_wait_commit+0xa9/0x130
[<ffffffff812e2e3c>] jbd2_complete_transaction+0x5c/0xa0
[<ffffffff81286608>] ext4_sync_file+0x188/0x2f0
[<ffffffff81234d7b>] vfs_fsync_range+0x4b/0xb0
[<ffffffff81234e3d>] do_fsync+0x3d/0x70
[<ffffffff812350d0>] SyS_fsync+0x10/0x20
[<ffffffff817ec7b6>] entry_SYSCALL_64_fastpath+0x16/0x75
[<ffffffffffffffff>] 0xffffffffffffffff



When clients hang, all they stuck at specific torrent - but it's random torrent -. and number of opened files from lsof command are same.
Any idea?
Thank you


엑세스 주식회사 XS INC. ⊂ 팀 장 서 정 우 / 徐 政 佑/ Seo Jeong Woo
서울시 구로구 구로3동 197-5 삼성IT밸리 1004호
Mobile [phone] / Office 02-2088-3243
FAX [phone] / E-mail ***@xsinc.co.kr

[Łukasz Taczuk]

Hi,

Post by Jeong Woo Seo
OS is Ubuntu 14.04 LTS and filesystem is NTFS-3G.

Ubuntu 14.04 LTS has *really* old libtorrent packages.
I've experienced multiple crashes with what is provided in the original
14.04 repository.

Either try to use some debs from more up to date ubuntu releases (I can't
guarantee you the debs will work out of the box since I have not checked
that) or recompile libtorrent yourself.

[Jeong Woo Seo]

I forgot to specify version of libtorrent.I manually downloaded source and built it. The version is 1.1.0
And even when i used default version of 14.04 , things happened.
Thank you




엑세스 주식회사 XS INC. ⊂ 팀 장 서 정 우 / 徐 政 佑/ Seo Jeong Woo
서울시 구로구 구로3동 197-5 삼성IT밸리 1004호
Mobile [phone] / Office 02-2088-3243
FAX [phone] / E-mail ***@xsinc.co.kr

-----Original Message-----
From: "Łukasz Taczuk"<***@gmail.com>
To: "Jeong Woo Seo"<***@xsinc.co.kr>; "General discussion about libtorrent"<libtorrent-***@lists.sourceforge.net>;
Cc:
Sent: 2016-05-26 (목) 05:12:18
Subject: Re: [libtorrent] libtorrent with python binding hangs sometimes

Hi, OS is Ubuntu 14.04 LTS and filesystem is NTFS-3G.
Ubuntu 14.04 LTS has *really* old libtorrent packages.I've experienced multiple crashes with what is provided in the original 14.04 repository. Either try to use some debs from more up to date ubuntu releases (I can't guarantee you the debs will work out of the box since I have not checked that) or recompile libtorrent yourself. --
Lukasz Taczuk

[Arvid Norberg]

at the face of it, it looks like a bug in the filesystem. NTFS-3G runs in
user space on top of fuse, doesn't it? I believe there are a lot of moving
parts involved in it that can fail, especially under pressure.

Post by Jeong Woo Seo
I forgot to specify version of libtorrent.I manually downloaded source
and built it. The version is 1.1.0
And even when i used default version of 14.04 , things happened.
Thank you
엑세스 주식회사 XS INC. ⊂ 팀 장 서 정 우 / 徐 政 佑/ Seo Jeong Woo
서울시 구로구 구로3동 197-5 삼성IT밸리 1004호
Mobile [phone] / Office 02-2088-3243
-----Original Message-----
Sent: 2016-05-26 (목) 05:12:18
Subject: Re: [libtorrent] libtorrent with python binding hangs sometimes
Hi, OS is Ubuntu 14.04 LTS and filesystem is NTFS-3G.
Ubuntu 14.04 LTS has *really* old libtorrent packages.I've experienced
multiple crashes with what is provided in the original 14.04 repository.
Either try to use some debs from more up to date ubuntu releases (I can't
guarantee you the debs will work out of the box since I have not checked
that) or recompile libtorrent yourself. --
Lukasz Taczuk
------------------------------------------------------------------------------
Mobile security can be enabling, not merely restricting. Employees who
bring their own devices (BYOD) to work are irked by the imposition of MDM
restrictions. Mobile Device Manager Plus allows you to control only the
apps on BYO-devices by containerizing them, leaving personal data
untouched!
https://ad.doubleclick.net/ddm/clk/304595813;131938128;j
_______________________________________________
Libtorrent-discuss mailing list
https://lists.sourceforge.net/lists/listinfo/libtorrent-discuss

[Jeong Woo Seo]

is it related to kernel version?
It occurs only when install newer than 3.19 kernel.






엑세스 주식회사 XS INC. ⊂ 팀 장 서 정 우 / 徐 政 佑/ Seo Jeong Woo
서울시 구로구 구로3동 197-5 삼성IT밸리 1004호
Mobile [phone] / Office 02-2088-3243
FAX [phone] / E-mail ***@xsinc.co.kr

-----Original Message-----
From: "Arvid Norberg"<***@gmail.com>
To: "Jeong Woo Seo"<***@xsinc.co.kr>; "General discussion about libtorrent"<libtorrent-***@lists.sourceforge.net>;
Cc: "Łukasz Taczuk"<***@gmail.com>;
Sent: 2016-05-26 (목) 08:22:48
Subject: Re: [libtorrent] libtorrent with python binding hangs sometimes

at the face of it, it looks like a bug in the filesystem. NTFS-3G runs in user space on top of fuse, doesn't it? I believe there are a lot of moving parts involved in it that can fail, especially under pressure.
On Wed, May 25, 2016 at 4:25 PM, Jeong Woo Seo <***@xsinc.co.kr> wrote:




I forgot to specify version of libtorrent.I manually downloaded source and built it. The version is 1.1.0

And even when i used default version of 14.04 , things happened.

Thank you









엑세스 주식회사 XS INC. ⊂ 팀 장 서 정 우 / 徐 政 佑/ Seo Jeong Woo

서울시 구로구 구로3동 197-5 삼성IT밸리 1004호

Mobile [phone] / Office 02-2088-3243

FAX [phone] / E-mail ***@xsinc.co.kr



-----Original Message-----

From: "Łukasz Taczuk"<***@gmail.com>

To: "Jeong Woo Seo"<***@xsinc.co.kr>; "General discussion about libtorrent"<libtorrent-***@lists.sourceforge.net>;

Cc:

Sent: 2016-05-26 (목) 05:12:18

Subject: Re: [libtorrent] libtorrent with python binding hangs sometimes



Hi, OS is Ubuntu 14.04 LTS and filesystem is NTFS-3G.

Ubuntu 14.04 LTS has *really* old libtorrent packages.I've experienced multiple crashes with what is provided in the original 14.04 repository. Either try to use some debs from more up to date ubuntu releases (I can't guarantee you the debs will work out of the box since I have not checked that) or recompile libtorrent yourself. --

Lukasz Taczuk





------------------------------------------------------------------------------

Mobile security can be enabling, not merely restricting. Employees who

bring their own devices (BYOD) to work are irked by the imposition of MDM

restrictions. Mobile Device Manager Plus allows you to control only the

apps on BYO-devices by containerizing them, leaving personal data untouched!

https://ad.doubleclick.net/ddm/clk/304595813;131938128;j

_______________________________________________

Libtorrent-discuss mailing list

Libtorrent-***@lists.sourceforge.net

https://lists.sourceforge.net/lists/listinfo/libtorrent-discuss


--
Arvid Norberg