Maxwell Render

Maxwell Render Information Repository
It is currently Thu Jun 20, 2013 7:57 am

All times are UTC + 1 hour [ DST ]




Post new topic Reply to topic  [ 13 posts ] 
Author Message
PostPosted: Thu Dec 29, 2011 7:13 pm 

Joined: Mon Apr 11, 2005 10:47 am
Posts: 1536
Location: Germany
I don't know when this problem occured the first time - maybe after the 2.5 update - but almost every time i start a coop job with 4 or 5 nodes one or two of them are transfering the mxs and dependencies VERY slow and these nodes are starting up to 50min later then.
It seems that it begins to copy the mxs (the mxs appears in the temp directory of the node). The node is showing "New job order received"; "Connection for scene file reception." and then the mxs-transfer seems to be paused. Then, after maybe 15-30min (sometimes earlier) the mxs-transfer is completed and the texture transfer starts, but still much too slow - it takes 20-30min to copy 200-300MB of textures.
It's not the same node all the time, but changing.

:?:

manager Win7x64, nodes WinXPx64, Kaspersky Internet Security running on all machines
all with onboard lan 1Gbit
switch Netgear GS716T 1Gbit, all energy saving settings disabled


since it looks like i'm the only one facing this problem, are there any known network settings that should be made?!? :?


Top
 Profile  
 
PostPosted: Sat Dec 31, 2011 1:19 pm 
User avatar

Joined: Wed Jan 26, 2005 8:30 pm
Posts: 7406
Location: Uzbjeckiazutjenikitzistan
Did you try with Kaspersky off just to see if it's not delaying the transfer by scanning the files etc.

_________________
Next Limit Team
Merchant of happiness


Top
 Profile  
 
PostPosted: Sat Dec 31, 2011 3:12 pm 

Joined: Mon Apr 11, 2005 10:47 am
Posts: 1536
Location: Germany
yes... no difference :(

but it seems that i'm the only one with this problem... so i think it must be network related

btw. all energy saving settings of the network cards are disabled as well.


Top
 Profile  
 
PostPosted: Wed Jan 18, 2012 6:03 pm 

Joined: Thu Oct 13, 2005 11:31 am
Posts: 4
Location: Singapore
I had a similar issue and it took me a while to get to the root of it. I am using all win 7 x64 machines and have a serverless win home group setup running. Only after switching to static IP addresses did the problem with the nodes resolve. (was on DHCP before). Perhaps that helps. Make sure the firewalls are off.

Cheers


Top
 Profile  
 
PostPosted: Thu Jan 19, 2012 3:45 pm 

Joined: Thu Oct 13, 2005 11:31 am
Posts: 4
Location: Singapore
I spoke too soon...sigh. Network was only stable for 24 hours... My nodes are erratic again...I can see them, all access paths are clear, yet one of 3 nodes always doesn't receive the .mxs file and stays there. Worst is that it's not consistently the same node. It keeps changing...


Top
 Profile  
 
PostPosted: Thu Jan 19, 2012 4:45 pm 

Joined: Mon Apr 11, 2005 10:47 am
Posts: 1536
Location: Germany
so we are already two... welcome to the club! ;)

i have the whole network running with static ip addresses. And disabling KIS didn't make a change. Maybe there is still something running in the background... i don't know. i think i'll try to disable all kaspersky related services or maybe uninstall it.
But i don't think this will help, because it was working for 5-6 months with KIS enabled (with 1-2 nodes in the network). As i said before, i don't remember exactly when it stopped to work... maybe after i added the third node.


Top
 Profile  
 
PostPosted: Mon Jan 23, 2012 8:47 pm 

Joined: Thu Oct 13, 2005 11:31 am
Posts: 4
Location: Singapore
I have 3 nodes too... It worked flawlessly with two before. now it does work 2 out of 10 times. Sigh. There is nothing more I can change. Real frustrating. Must be a win 7 over control issue. I can see and access all relevant folders. The nodes connect, no issues there but one of them (random, not the same all the time) won't start. No license issues either, all installed correctly.


Top
 Profile  
 
PostPosted: Fri Jan 27, 2012 1:29 pm 

Joined: Mon Apr 11, 2005 10:47 am
Posts: 1536
Location: Germany
i have added two more nodes. Now it's 5 out of 7... two are always late. This really makes no sense at all :roll:


Top
 Profile  
 
PostPosted: Fri Jan 27, 2012 8:40 pm 

Joined: Tue Jan 15, 2008 7:01 am
Posts: 527
I had this happen due to not having enough ram in my nodes. I had 8 gigs in each one but if I did a very large scene this would happen. added another 4 gigs to each node and it fixed the problem immediately. Maybe that's the issue in this case?

_________________
www.justingoode.com


Top
 Profile  
 
PostPosted: Fri Jan 27, 2012 10:53 pm 

Joined: Mon Apr 11, 2005 10:47 am
Posts: 1536
Location: Germany
i think this can't be the problem. They have 12 or 16 GB and the biggest job took only ~9-10 GB in memory. They are rendering it, but with a huge delay, depending on the size of the submitted data (~1 hour later with 660MB for scene and textures)
There must be a problem with the connection. It's like it gets throttled to 10 mbit for maxwell. But it's showing 1Gbit and the file transfer in win explorer is ok. I have bought an Intel PCIe network card which i'll try tomorrow.


Top
 Profile  
 
PostPosted: Sat Jan 28, 2012 12:39 am 
User avatar

Joined: Wed Oct 19, 2005 7:06 am
Posts: 1708
Location: Leeds, UK
Out of 26 nodes I have had one then two which slowed to a crawl. X64 XP Pro on each and every time it was the same two nodes. Updating these two to the latest Windows update solved it for a while but then they returned to being slow. 2.5.1 and 2.6.0 Maxwell seem to have been the same.
Here are a few things you can try:-
Defragging, disk checking, purging temp folders and files can help, as can an uninstall and reinstall of Maxwell.
Running a small co-operative render scene, with a single sphere rendered at low res to a high SL will help flush nodes of large files. If the slow nodes are not affected then it's possibly a RAM fault or could be a slow/loose network connection.
Try pinging each node and compare times, this can help identify a slow connection.
Try turning off send dependencies and pack and go your scene to a network folder accessible to all nodes. That might help too.
Check the Virtual memory settings for the slow nodes too that they are matching, however this can only help if it's the same nodes which are hanging.
Run the nodes in deep debug mode to see if theres any hidden issues not being reportred in the main console windows for the Mxnetwork rendernodes. In any Mxnetwork object's Preferences, select Deep Debug from the Minimum Log Verbosity drop down menu and restart Mxnetwork.

Tim.

_________________
http://emp3d.com
-------------------------------------
Next Limit Certified Training Centre for Maxwell Render.
Maxwell Render Training & consultancy. A-Team tester.


Top
 Profile  
 
PostPosted: Sat Jan 28, 2012 12:18 pm 

Joined: Thu Oct 13, 2005 11:31 am
Posts: 4
Location: Singapore
For win 7 networks without server, here is what works for me. Boot all machines and manually set all clients network settings to "home network" make sure all firewalls are off. Make sure all network paths are reconnected. Test that they work. That gets all my nodes to connect correctly. Windows 7 resets/looses the network settings every time the machines are switched off and that causes problems on restart. I have consistency now. Nodes download and start correctly that way. Disconnects only happen when ram overflows in my case which requires the frame sizes to be lowered. I do render very large single frames in excess of 5k x 10k at times so ram tends to be close to capacity at 80-90%. leave some margin to avoid disconnects.

Cheers and happy render.


Top
 Profile  
 
PostPosted: Mon Apr 22, 2013 3:51 pm 

Joined: Mon Apr 11, 2005 10:47 am
Posts: 1536
Location: Germany
The problem is still there...
I have changed the Server OS from WinXP to Win7 last year and thought it was better afterwards, but now i think that nothing really changed. It can start normally for some jobs and then 1-3, sometimes up to 6 nodes are missing.
If i restart the node, it starts rendering immediately but doesn't get added to the job. It is still listed as "ready" then. Merging ignores these nodes.
And it is not possible to add them later manually to the job (which is VERY annoying btw.)
I think i'll change all nodes to win7 too and see if this helps - my win7 nodes are normally connecting without any delay (sometimes not but maybe this is another problem) :roll:


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 13 posts ] 

All times are UTC + 1 hour [ DST ]


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB® Forum Software © phpBB Group