Ayende @ Rahien

Hi!
My name is Ayende Rahien
Founder of Hibernating Rhinos LTD and RavenDB.
You can reach me by phone or email:

ayende@ayende.com

+972 52-548-6969

, @ Q c

Posts: 5,949 | Comments: 44,548

filter by tags archive

UberProf performance challenges


One of the things that the profiler is supposed to do is to handle large amount of data, so I was pretty bummed to hear that users are running into issues when they try to use the profiler in high load scenarios, such as load tests.

Luckily, one of the things that the profiler can do is output to a file, which let me simulate what is going on on the customer site very easily.

The first performance problem is that the profiler isn’t processing things fast enough:

image

The second is that there are some things that just totally breaks my expectations

image

There are solutions for those problems, and I guess that I know what I’ll be doing in the near future :-)


Comments

Romain Verdier

Is the rhino in the waiting dialog animated?

Glenn F. Henriksen

So that's 53k queries in one data context? Seems a bit much :D

Ayende Rahien

Yes, that is NOT something that the profiler expects to see, I am afraid to say.

Glenn F. Henriksen

What's with the loading picture, 160.062 out of 11.957? Textbox overflow?

Ayende Rahien

Glenn,

160K loaded, 11K remaining to be processed.

Glenn F. Henriksen

Ah, I guess it's easier to see it when you see the numbers counting.

smurf

if you write about features of ÜberProf, do they affect all profilers or do i need an ÜberProf license to get them?

Ayende Rahien

smurf,

When I am talking about UberProf, I am referring to all profilers.

Paulo Quicoli

I dont know internals of your loading data... but, maybe, use some of parallelism from .NET 4 would be good. :)

John Farrell

Bah, thats nothing, I've done 1.6 million in a single context before. :p

Why? It was quicker to drag a table into EF than write the sql query manually for a simple nightly processing job. Performance overhead for using an ORM was in "who cares" territory so it worked.

Comment preview

Comments have been closed on this topic.

FUTURE POSTS

No future posts left, oh my!

RECENT SERIES

  1. The RavenDB Comic Strip (3):
    28 May 2015 - Part III – High availability & sleeping soundly
  2. Special Offer (2):
    27 May 2015 - 29% discount for all our products
  3. RavenDB Sharding (3):
    22 May 2015 - Adding a new shard to an existing cluster, splitting the shard
  4. Challenge (45):
    28 Apr 2015 - What is the meaning of this change?
  5. Interview question (2):
    30 Mar 2015 - fix the index
View all series

RECENT COMMENTS

Syndication

Main feed Feed Stats
Comments feed   Comments Feed Stats