https://elated-raman-42e0c2.netlify.app/tags/profile/Recent content in Profile on Sawyer Zheng's BlogHugozh-cnThu, 26 May 2022 18:44:41 +0800https://elated-raman-42e0c2.netlify.app/post/notes/python/memory_profile/Tue, 29 Jun 2021 00:00:00 +0000https://elated-raman-42e0c2.netlify.app/post/notes/python/memory_profile/<div id="outline-container-headline-1" class="outline-2"> <h2 id="headline-1"> 工具 </h2> <div id="outline-text-headline-1" class="outline-text-2"> <ul> <li> <p><a href="https://docs.python.org/3/library/tracemalloc.html">tracemalloc</a></p> <ul> <li>内存分配跟踪 trace memory allocations</li> <li>官方库</li> </ul> </li> <li><a href="https://github.com/pythonprofilers/memory_profiler">memory_profiler</a></li> <li> <p><a href="https://pypi.org/project/line-profiler/">line-profiler</a></p> <ul> <li>逐行 profile</li> </ul> </li> </ul> </div> </div> <div id="outline-container-headline-2" class="outline-2"> <h2 id="headline-2"> line-profiler </h2> <div id="outline-text-headline-2" class="outline-text-2"> <ul> <li> <p>命令行使用</p> <div class="src src-sh"> <div class="highlight"><div class="chroma"> <table class="lntable"><tr><td class="lntd"> <pre tabindex="0" class="chroma"><code><span class="lnt">1 </span><span class="lnt">2 </span><span class="lnt">3 </span><span class="lnt">4 </span><span class="lnt">5 </span></code></pre></td> <td class="lntd"> <pre tabindex="0" class="chroma"><code class="language-sh" data-lang="sh"><span class="line"><span class="cl"><span class="c1"># 第一步 ---&gt; 生成 profile 结果文件 --&gt; your_script.py.lprof</span> </span></span><span class="line"><span class="cl">kernprof -l -v your_script.py </span></span><span class="line"><span class="cl"> </span></span><span class="line"><span class="cl"><span class="c1"># 第二步 ---&gt; 格式化展示</span> </span></span><span class="line"><span class="cl">python -m line_profiler your_script.py.lprof</span></span></code></pre></td></tr></table> </div> </div> </div> </li> <li> <p>例子</p> <ul> <li>注意：不需要导入 profile 装饰器</li> <li> <p><a href="https://gist.github.com/danriti/8015889">Line Profiling in Python · GitHub</a></p>https://elated-raman-42e0c2.netlify.app/post/notes/python/profile/Fri, 11 Jun 2021 00:00:00 +0000https://elated-raman-42e0c2.netlify.app/post/notes/python/profile/<div id="outline-container-headline-1" class="outline-2"> <h2 id="headline-1"> 工具 </h2> <div id="outline-text-headline-1" class="outline-text-2"> <ul> <li>graphviz</li> <li>snakeviz</li> <li><a href="https://medium.com/@narenandu/profiling-and-visualization-tools-in-python-89a46f578989">gprof2dot</a></li> </ul> </div> </div> <div id="outline-container-headline-2" class="outline-2"> <h2 id="headline-2"> profiler </h2> <div id="outline-text-headline-2" class="outline-text-2"> <ul> <li>cProfile</li> <li>profile</li> </ul> </div> </div> <div id="outline-container-headline-3" class="outline-2"> <h2 id="headline-3"> 使用 </h2> <div id="outline-text-headline-3" class="outline-text-2"> <div id="outline-container-headline-4" class="outline-3"> <h3 id="headline-4"> snakeviz </h3> <div id="outline-text-headline-4" class="outline-text-3"> <div class="src src-sh"> <div class="highlight"><div class="chroma"> <table class="lntable"><tr><td class="lntd"> <pre tabindex="0" class="chroma"><code><span class="lnt">1 </span><span class="lnt">2 </span><span class="lnt">3 </span></code></pre></td> <td class="lntd"> <pre tabindex="0" class="chroma"><code class="language-sh" data-lang="sh"><span class="line"><span class="cl">python -m cProfile -o /to/profile_result.prof your_program.py args </span></span><span class="line"><span class="cl"> </span></span><span class="line"><span class="cl">snakeviz /to/profile.prof</span></span></code></pre></td></tr></table> </div> </div> </div> <ul> <li> <p>结果</p> <ul> <li>网站</li> </ul> </li> </ul> </div> </div> <div id="outline-container-headline-5" class="outline-3"> <h3 id="headline-5"> gprof2dot </h3> <div id="outline-text-headline-5" class="outline-text-3"> <div class="src src-sh"> <div class="highlight"><div class="chroma"> <table class="lntable"><tr><td class="lntd"> <pre tabindex="0" class="chroma"><code><span class="lnt">1 </span><span class="lnt">2 </span><span class="lnt">3 </span></code></pre></td> <td class="lntd"> <pre tabindex="0" class="chroma"><code class="language-sh" data-lang="sh"><span class="line"><span class="cl">python -m cProfile -o profile.pstats program.py args </span></span><span class="line"><span class="cl"> </span></span><span class="line"><span class="cl">gprof2doc -f pstats /to/profile.pstats <span class="p">|</span> dot -Tpng -o result.png</span></span></code></pre></td></tr></table> </div> </div> </div> <ul> <li> <p>结果</p> <ul> <li>函数调用图片</li> </ul> </li> </ul> </div> </div> </div> </div> <div id="outline-container-headline-6" class="outline-2"> <h2 id="headline-6"> 代码速度 </h2> <div id="outline-text-headline-6" class="outline-text-2"> <div id="outline-container-headline-7" class="outline-3"> <h3 id="headline-7"> set 快于 list </h3> <div id="outline-text-headline-7" class="outline-text-3"> <p>x in set 快于 x in list</p>