[netcdfgroup] Fw: Profiling NetCDF4-python

• To: "netcdfgroup@xxxxxxxxxxxxxxxx" <netcdfgroup@xxxxxxxxxxxxxxxx>
• Subject: [netcdfgroup] Fw: Profiling NetCDF4-python
• From: Matthew Jones <M.Jones3@xxxxxxxxxxxxxxxxx>
• Date: Mon, 9 May 2016 10:35:11 +0000
• Authentication-results: unidata.ucar.edu; dkim=none (message not signed) header.d=none;unidata.ucar.edu; dmarc=none action=none header.from=pgr.reading.ac.uk;
• Spamdiagnosticmetadata: NSPM
• Spamdiagnosticoutput: 1:23

Hi


I am trying to profile my NetCDF4-python code to see how to improve read 
performance, which I have identified as the bottleneck. I have done this using 
kcachegrind and line_profiler.


I want to delve a bit deeper into the library to see where the performance is 
dropping. I can't work out how to use line_profiler with the @profile decorator 
in the variable class. I also can't work out how to get kcachegrind to delve 
into the library because the slicing syntax var[...] is not an explicit 
function call, and I can't get var.__getitem__() to do the same thing.


Does anyone have any ideas how I could get more information from profiling the 
netcdf4 library?


Many thanks

Matt



----------------------------------------
Matthew Jones
PhD Student
Atmosphere, Oceans and Climate
Department of Meteorology,
University of Reading

Room 288, ESSC, Harry Pitt Building,
3 Earley Gate, Reading, RG6 6AL, UK


https://www.linkedin.com/pub/matthew-jones/8b/b81/25a
http://www.met.reading.ac.uk/users/users/1887

• Follow-Ups:
  • Re: [netcdfgroup] Fw: Profiling NetCDF4-python
    • From: Nick Papior