aboutsummaryrefslogtreecommitdiffstatshomepage
path: root/OpenSim/Region/ClientStack/Linden/UDP/LLUDPServer.cs (unfollow)
Commit message (Collapse)AuthorFilesLines
2014-08-02Added "debug packet --all" option, which changes the packet logging level ↵Oren Hurvitz1-8/+26
for both current and future clients The existing "--default" option only changes the logging level for future clients.
2014-08-02Fixed the logic that decides if a packet was queued (it was reversed)Oren Hurvitz1-5/+6
2013-11-06Add IncomingPacketsResentCount clientstack statisticsJustin Clark-Casey (justincc)1-0/+23
This records how many packets were indicated to be resends by clients Not 100% reliable since clients can lie about resends, but usually would indicate if clients are not receiving UDP acks at all or in a manner they consider timely.
2013-10-31Start counting resent packets in the places that I missed when the stat was ↵Justin Clark-Casey (justincc)1-0/+4
first added a few commits ago
2013-10-31Add OutgoingPacketsResentCount clientstack stat.Justin Clark-Casey (justincc)1-0/+27
This allows one to monitor the total number of messages resent to clients over time. A constantly increasing stat may indicate a general server network or overloading issue if a fairly high proportion of packets sent A smaller constantly increasing stat may indicate a problem with a particular client-server connection, would need to check "show queues" in this case.
2013-10-24Comment out LLUDPServer.BroadcastPacket() to reduce code complexity. ↵Justin Clark-Casey (justincc)1-38/+38
Appears to be a never used method.
2013-10-24Only set the data present event if we actually queued an outoing packet (not ↵Justin Clark-Casey (justincc)1-4/+17
if we sent immediately)
2013-09-27refactor: Rename Scene.AddNewClient() to AddNewAgent() to make it obvious in ↵Justin Clark-Casey (justincc)1-1/+1
the code that this is symmetric with CloseAgent()
2013-09-27refactor: rename Scene.IncomingCloseAgent() to CloseAgent() in order to make ↵Justin Clark-Casey (justincc)1-2/+2
it clear that all non-clientstack callers should be using this rather than RemoveClient() in order to step through the ScenePresence state machine properly. Adds IScene.CloseAgent() to replace RemoveClient()
2013-09-25Reinsert client.SceneAgent checks into ↵Justin Clark-Casey (justincc)1-11/+26
LLUDPServer.HandleCompleteMovementIntoRegion() to fix race condition regression in commit 7dbc93c (Wed Sep 18 21:41:51 2013 +0100) This check is necessary to close a race condition where the CompleteAgentMovement processing could proceed when the UseCircuitCode thread had added the client to the client manager but before the ScenePresence had registered to process the CompleteAgentMovement message. This is most probably why the message appeared to get lost on a proportion of entity transfers. A better long term solution may be to set the IClientAPI.SceneAgent property before the client is added to the manager.
2013-09-25Reinsert 200ms sleep accidentally removed in commit 7dbc93c (Wed Sep 18 ↵Justin Clark-Casey (justincc)1-2/+2
21:41:51 2013 +0100)
2013-09-18Double the time spent waiting for a UseCircuitCode packet in ↵Justin Clark-Casey (justincc)1-1/+1
LLUDPServer.HandleCompleteMovementIntoRegion() This is to deal with one aspect of http://opensimulator.org/mantis/view.php?id=6755 With the V2 teleport arrangements, viewers appear to send the single UseCircuitCode and CompleteAgentMovement packets immediately after each other Possibly, on occasion a poor network might drop the initial UseCircuitCode packet and by the time it retries, the CompleteAgementMovement has timed out and the teleport fails. There's no apparant harm in doubling the wait time (most times only one wait will be performed) so trying this.
2013-09-18Change logging to provide more information on ↵Justin Clark-Casey (justincc)1-10/+39
LLUDPServer.HandleCompleteMovementIntoRegion() Add more information on which endpoint sent the packet when we have to wait and if we end up dropping the packet Only check if the client is active - other checks are redundant since they can only failed if IsActve = false
2013-08-14Add stat clientstack.<scene>.IncomingPacketsOrphanedCount to record ↵Justin Clark-Casey (justincc)1-4/+29
well-formed packets that were not initial connection packets and could not be associated with a connected viewer.
2013-08-14Count any incoming packet that could not be recognized as an LLUDP packet as ↵Justin Clark-Casey (justincc)1-21/+44
a malformed packet. Record this as stat clientstack.<scene>.IncomingPacketsMalformedCount Used to detect if a simulator is receiving significant junk UDP Decimates the number of packets between which a warning is logged and prints the IP source of the last malformed packet when logging
2013-08-08Fix an issue where under teleport v2 protocol, teleporting from regions in ↵Justin Clark-Casey (justincc)1-3/+3
an line from A->B->C would not close region A when reaching C The root cause was that v2 was only closing neighbour agents if the root connection also needed a close. However, fixing this requires the neighbour regions also detect when they should not close due to re-teleports re-establishing the child connection. This involves restructuring the code to introduce a scene presence state machine that can serialize the different add and remove client calls that are now possible with the late close of the This commit appears to fix these issues and improve teleport, but still has holes on at least quick reteleporting (and possibly occasionally on ordinary teleports). Also, has not been completely tested yet in scenarios where regions are running on different simulators
2013-08-01minor: Add name to debug lludp packet level feedback on consoleJustin Clark-Casey (justincc)1-1/+1
2013-08-01Try a different approach to slow terrain update by always cycling the loop ↵Justin Clark-Casey (justincc)1-1/+2
immediately if any data was sent, rather than waiting. What I believe is happening is that on initial terrain send, this is done one packet at a time. With WaitOne, the outbound loop has enough time to loop and wait again after the first packet before the second, leading to a slower send. This approach instead does not wait if a packet was just sent but instead loops again, which appears to lead to a quicker send without losing the cpu benefit of not continually looping when there is no outbound data.
2013-08-01Revert "Issue: painfully slow terrain loading. The cause is commit ↵Justin Clark-Casey (justincc)1-5/+5
d9d995914c5fba00d4ccaf66b899384c8ea3d5eb (r/23185) -- the WaitOne on the UDPServer. Putting it back to how it was done solves the issue. But this may impact CPU usage, so I'm pushing it to test if it does." This reverts commit 59b461ac0eaae1cc34bb82431106fdf0476037f3.
2013-08-01Issue: painfully slow terrain loading. The cause is commit ↵Diva Canto1-5/+5
d9d995914c5fba00d4ccaf66b899384c8ea3d5eb (r/23185) -- the WaitOne on the UDPServer. Putting it back to how it was done solves the issue. But this may impact CPU usage, so I'm pushing it to test if it does.
2013-07-29minor: Add timeout secs to connection timeout message. Change message to ↵Justin Clark-Casey (justincc)1-8/+9
reflect it is a timeout due to no data received rather than an ack issue.
2013-07-29Fix issue just introduced in 8efe4bfc2ed7086e9fdf4812297e6525f955f6ac where ↵Justin Clark-Casey (justincc)1-1/+1
I accidentally left in a test line to force very quick client unack
2013-07-29Make "abnormal thread terminations" into "ClientLogoutsDueToNoReceives" and ↵Justin Clark-Casey (justincc)1-5/+21
add this to the StatsManager This reflects the actual use of this stat - it hasn't recorded general exceptions for some time. Make the sim extra stats collector draw the data from the stats manager rather than maintaing this data itself.
2013-07-24Deleted all [ZZZ] debug messages.Diva Canto1-5/+0
2013-07-24One more thing to test in order to let CompleteMovement go up the stack.Diva Canto1-2/+3
2013-07-24Minor adjustment on timings of waits.Diva Canto1-4/+19
2013-07-24New Teleport protocol (V2), still compatible with V1 and older. (version of ↵Diva Canto1-0/+68
the destination is being checked) In this new protocol, and as committed before, the viewer is not sent EnableSimulator/EstablishChildCommunication for the destination. Instead, it is sent TeleportFinish directly. TeleportFinish, in turn, makes the viewer send a UserCircuitCode packet followed by CompleteMovementIntoRegion packet. These 2 packets tend to occur one after the other almost immediately to the point that when CMIR arrives the client is not even connected yet and that packet is ignored (there might have been some race conditions here before); then the viewer sends CMIR again within 5-8 secs. But the delay between them may be higher in busier regions, which may lead to race conditions. This commit improves the process so there are are no race conditions at the destination. CompleteMovement (triggered by the viewer) waits until Update has been sent from the origin. Update, in turn, waits until there is a *root* scene presence -- so making sure CompleteMovement has run MakeRoot. In other words, there are two threadlets at the destination, one from the viewer and one from the origin region, waiting for each other to do the right thing. That makes it safe to close the agent at the origin upon return of the Update call without having to wait for callback, because we are absolutely sure that the viewer knows it is in th new region. Note also that in the V1 protocol, the destination was getting UseCircuitCode from the viewer twice -- once on EstablishAgentCommunication and then again on TeleportFinish. The second UCC was being ignored, but it shows how we were not following the expected steps...
2013-07-23Add proper method doc and comments to m_dataPresentEvent (from d9d9959)Justin Clark-Casey (justincc)1-2/+13
2013-07-23Add clientstack.InboxPacketsCount stat. This records the number of packets ↵Justin Clark-Casey (justincc)1-0/+13
waiting to be processed at the second stage (after initial UDP processing) If this consistently increases then this is a problem since it means the simulator is receiving more requests than it can distribute to other parts of the code.
2013-07-23Add clientstack.OutgoingUDPSendsCount stat to show number of outbound UDP ↵Justin Clark-Casey (justincc)1-3/+15
packets sent by a region per second
2013-07-23Record raw number of UDP receives as clientstack.IncomingUDPReceivesCountJustin Clark-Casey (justincc)1-0/+13
2013-07-23Add AverageUDPProcessTime stat to try and get a handle on how long we're ↵Justin Clark-Casey (justincc)1-2/+17
taking on the initial processing of a UDP packet. If we're not receiving packets with multiple threads (m_asyncPacketHandling) then this is critical since it will limit the number of incoming UDP requests that the region can handle and affects packet loss. If m_asyncPacketHandling then this is less critical though a long process will increase the scope for threads to race. This is an experimental stat which may be changed.
2013-07-22Added check for user movement specification before discarding an incomingRobert Adams1-1/+2
AgentUpdate packet. This fixes the problem with vehicles not moving forward after the first up-arrow. Code to fix a potential exception when using different IClientAPIs.
2013-07-21Fixed the stats in show client stats. Also left some comments with ↵Diva Canto1-0/+2
observations about AgentUpdates.
2013-07-21Make the check as to whether any particular inbound AgentUpdate packet is ↵Justin Clark-Casey (justincc)1-2/+15
significant much earlier in UDP processing (i.e. before we pointlessly place such packets on internal queues, etc.) Appears to have some impact on cpu but needs testing.
2013-07-21Hack in console command "debug lludp toggle agentupdate" to allow ↵Justin Clark-Casey (justincc)1-0/+24
AgentUpdate in packets to be discarded at a very early stage. Enabling this will stop anybody from moving on a sim, though all other updates should be unaffected. Appears to make some cpu difference on very basic testing with a static standing avatar (though not all that much). Need to see the results with much higher av numbers.
2013-07-21Fix up a temporary debugging change from last commit which stopped "lludp ↵Justin Clark-Casey (justincc)1-2/+1
stop out" from actually doing anything
2013-07-21Do some simple queue empty checks in the main outgoing udp loop instead of ↵Justin Clark-Casey (justincc)1-2/+2
always performing these on a separate fired thread. This appears to improve cpu usage since launching a new thread is more expensive than performing a small amount of inline logic. However, needs testing at scale.
2013-07-18try Hacking in an AutoResetEvent to control the outgoing UDP loop instead of ↵Justin Clark-Casey (justincc)1-2/+8
a continuous loop with sleeps. Does appear to have a cpu impact but may need further tweaking
2013-07-15Revert the revertDiva Canto1-0/+2
Revert "Trying to hunt the CPU spikes recently experienced." This reverts commit ac73e702935dd4607c13aaec3095940fba7932ca.
2013-07-15Trying to hunt the CPU spikes recently experienced.Diva Canto1-2/+0
Revert "Comment out old inbound UDP throttling hack. This would cause the UDP" This reverts commit 38e6da5522a53c7f65eac64ae7b0af929afb1ae6.
2013-07-13Moved SendInitialDataToMe to earlier in CompleteMovement. Moved ↵Diva Canto1-1/+1
TriggerOnMakeRootAgent to the end of CompleteMovement. Justin, if you read this, there's a long story here. Some time ago you placed SendInitialDataToMe at the very beginning of client creation (in LLUDPServer). That is problematic, as we discovered relatively recently: on TPs, as soon as the client starts getting data from child agents, it starts requesting resources back *from the simulator where its root agent is*. We found this to be the problem behind meshes missing on HG TPs (because the viewer was requesting the meshes of the receiving sim from the departing grid). But this affects much more than meshes and HG TPs. It may also explain cloud avatars after a local TP: baked textures are only stored in the simulator, so if a child agent receives a UUID of a baked texture in the destination sim and requests that texture from the departing sim where the root agent is, it will fail to get that texture. Bottom line: we need to delay sending the new simulator data to the viewer until we are absolutely sure that the viewer knows that its main agent is in a new sim. Hence, moving it to CompleteMovement. Now I am trying to tune the initial rez delay that we all experience in the CC. I think that when I fixed the issue described above, I may have moved SendInitialDataToMe to much later than it should be, so now I'm moving to earlier in CompleteMovement.
2013-07-09Comment out old inbound UDP throttling hack. This would cause the UDPRobert Adams1-0/+2
reception thread to sleep for 30ms if the number of available user worker threads got low. It doesn't look like any of the UDP packet types are marked async so this check is 1) unnecessary and 2) really crazy since it stops up the reception thread under heavy load without any indication.
2013-07-04Add --default option to "debug lludp packet" command to allow packet logging ↵Justin Clark-Casey (justincc)1-17/+52
to be performed immediately from client start
2013-07-04change "debug packet" command to "debug lludp packet" to conform with other ↵Justin Clark-Casey (justincc)1-0/+59
"debug lludp" options also moves the implementing code into LLUDPServer.cs along with other debug commands from OpenSim.cs gets all debug lludp commands to only activate for the set scene if not root
2013-05-14Second take at HGTP-mesh bug: delay sending the initial data only for agents ↵Diva Canto1-1/+7
that are coming via TP (root agents)
2013-05-14Revert "HGTP-mesh bug: the mesh download requests were going to the ↵Diva Canto1-0/+3
departing sims for a little while. This was also true for local TPs. BUt for local TPs the assets are on the same server, so it doesn't matter. For HGTPs, it matters. This potential fix moves sending the initial data to later, after the client has completed the movement into the region. Fingers crossed that it doesn't mess other things up!" This reverts commit f32a21d96707f87ecbdaf42c0059f8494a119d31.
2013-05-14HGTP-mesh bug: the mesh download requests were going to the departing sims ↵Diva Canto1-3/+0
for a little while. This was also true for local TPs. BUt for local TPs the assets are on the same server, so it doesn't matter. For HGTPs, it matters. This potential fix moves sending the initial data to later, after the client has completed the movement into the region. Fingers crossed that it doesn't mess other things up!
2013-04-16refactor: Remove IClientNetworkServer.NetworkStop() in favour of existing ↵Justin Clark-Casey (justincc)1-5/+0
Stop(). This was an undocumented interface which I think was for long defunct region load balancing experiments. Also adds method doc for some IClientNetworkServer methods.
2013-03-15Fix server statistics always reporting zero for total network bytes in/out.Robert Adams1-19/+32
Clean up some parameter code in Statistics.Binary.