Comments on: Speed up your Web App by 1000% with 1 Line of SQL http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/ The Web Practitioner's Blog Sat, 11 Feb 2012 16:33:00 +0000 hourly 1 By: VPS, CDN and advanced server techniques: 2 | bitblogr.com http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-15515 VPS, CDN and advanced server techniques: 2 | bitblogr.com Sun, 04 Oct 2009 03:17:51 +0000 http://carsonified.com/?p=3172#comment-15515 [...] especially for your server side, you should be sure you set things up properly. Even at that, be sensitive to page load speeds and memory consumption. You can check out your server memory consumption and other vital details [...] [...] especially for your server side, you should be sure you set things up properly. Even at that, be sensitive to page load speeds and memory consumption. You can check out your server memory consumption and other vital details [...]

]]> By: cargames http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14970 cargames Sat, 12 Sep 2009 01:55:43 +0000 http://carsonified.com/?p=3172#comment-14970 This is fine for english, but i wonder if there are different semantics between ILIKE and lower, in languages that can upper/lower -case letters in various ways, like the turkish language. <a href="http://www.killercargames.com/" rel="nofollow">car games</a> This is fine for english, but i wonder if there are different semantics between ILIKE and lower, in languages that can upper/lower -case letters in various ways, like the turkish language.
car games

]]> By: Steve Schnepp http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14909 Steve Schnepp Thu, 10 Sep 2009 15:48:31 +0000 http://carsonified.com/?p=3172#comment-14909 @PaulM: I just posted a little about the bumpy road of functional indexing on http://blog.pwkf.org/post/2009/09/Databases%3A-Efficient-Case-insensitive-searches-with-Function-based-Indexing @PaulM:

I just posted a little about the bumpy road of functional indexing on http://blog.pwkf.org/post/2009/09/Databases%3A-Efficient-Case-insensitive-searches-with-Function-based-Indexing

]]> By: stickgames http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14857 stickgames Wed, 09 Sep 2009 08:20:10 +0000 http://carsonified.com/?p=3172#comment-14857 I tried to learn and implement Zend framework one time , but gave it up. To me it’s just too heavy and slow. <a href="http://www.ragdoller.com" rel="nofollow">stick games</a> I tried to learn and implement Zend framework one time , but gave it up. To me it’s just too heavy and slow.
stick games

]]> By: 9eFish http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14805 9eFish Mon, 07 Sep 2009 16:53:20 +0000 http://carsonified.com/?p=3172#comment-14805 <strong>Carsonified » Speed up your Web App by 1000% with 1 Line of SQL...</strong> 9efish.感谢你的文章 - Trackback from 9eFish... Carsonified » Speed up your Web App by 1000% with 1 Line of SQL…

9efish.感谢你的文章 – Trackback from 9eFish…

]]> By: Daily tech links for .net and related technologies - September 4-8, 2009 - Sanjeev Agarwal http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14795 Daily tech links for .net and related technologies - September 4-8, 2009 - Sanjeev Agarwal Mon, 07 Sep 2009 10:06:27 +0000 http://carsonified.com/?p=3172#comment-14795 [...] & Related Technologies Connecting to SQL Azure from SQL Management Studio 2008 Speed up your Web App by 1000% with 1 Line of SQL Restore MS SQL Server database from within your application(s) Mapping the Brain using SQL Server [...] [...] & Related Technologies Connecting to SQL Azure from SQL Management Studio 2008 Speed up your Web App by 1000% with 1 Line of SQL Restore MS SQL Server database from within your application(s) Mapping the Brain using SQL Server [...]

]]> By: flashgames http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14793 flashgames Mon, 07 Sep 2009 07:46:28 +0000 http://carsonified.com/?p=3172#comment-14793 Thanks for your website <a href="http://www.gameslemming.com" rel="nofollow">flashgames</a> Thanks for your website
flashgames

]]> By: Ashutosh http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14774 Ashutosh Sun, 06 Sep 2009 06:06:40 +0000 http://carsonified.com/?p=3172#comment-14774 Link-bait title, but anyways, here's a more optimized way: SELECT TOP 100 fieldname1, fieldname2 FROM table WHERE lower(fieldname) LIKE 'abc%'; 1. The TOP 100 in this case limits the result-set. Much faster when dealing with large datasets. 2. Defining the fieldname's (i.e.fieldname1, fieldname2 etc.) is better and faster than * (all fields). Link-bait title, but anyways, here’s a more optimized way:

SELECT TOP 100 fieldname1, fieldname2 FROM table WHERE lower(fieldname) LIKE ‘abc%’;

1. The TOP 100 in this case limits the result-set. Much faster when dealing with large datasets.

2. Defining the fieldname’s (i.e.fieldname1, fieldname2 etc.) is better and faster than * (all fields).

]]> By: PaulM http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14773 PaulM Sun, 06 Sep 2009 05:53:20 +0000 http://carsonified.com/?p=3172#comment-14773 If your database doesn't have functional indexes, this SQL won't help you. If an index exists on fieldname, then wrapping the conditional column/fieldname in the WHERE clause will invalidate what is stored in the index. So you will have to go the route @Krues8dr suggests or use something else. @James This kind of SQL using LIKE or equivalent doing wildcard searches is always a red flag. If you are releasing to production, a good practice is to get all the SQL which is generated and review it like a code review. @MariusX As a DBA I ask myself the same question. If the database is logging slow queries or queries without indexes (MySQL bias here) why can't it sample the statistics of the predicate/conditional columns in the WHERE clause and add an index on the fly (for the next time the query runs), like Machine Learning layer on top of the optimizer... Keeps me in a job until I finish development eh? If your database doesn’t have functional indexes, this SQL won’t help you. If an index exists on fieldname, then wrapping the conditional column/fieldname in the WHERE clause will invalidate what is stored in the index. So you will have to go the route @Krues8dr suggests or use something else.
@James
This kind of SQL using LIKE or equivalent doing wildcard searches is always a red flag.
If you are releasing to production, a good practice is to get all the SQL which is generated and review it like a code review.
@MariusX
As a DBA I ask myself the same question. If the database is logging slow queries or queries without indexes (MySQL bias here) why can’t it sample the statistics of the predicate/conditional columns in the WHERE clause and add an index on the fly (for the next time the query runs), like Machine Learning layer on top of the optimizer…
Keeps me in a job until I finish development eh?

]]> By: Sam http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14772 Sam Sun, 06 Sep 2009 05:15:56 +0000 http://carsonified.com/?p=3172#comment-14772 Talk about a misleading title. Is your application powered by a single SQL statement? Talk about a misleading title. Is your application powered by a single SQL statement?

]]> By: mebigfatguy http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14771 mebigfatguy Sun, 06 Sep 2009 04:42:00 +0000 http://carsonified.com/?p=3172#comment-14771 This is fine for english, but i wonder if there are different semantics between ILIKE and lower, in languages that can upper/lower -case letters in various ways, like the turkish language. This is fine for english, but i wonder if there are different semantics between ILIKE and lower, in languages that can upper/lower -case letters in various ways, like the turkish language.

]]> By: kenali dan kunjungi objek wisata di pandeglang http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14707 kenali dan kunjungi objek wisata di pandeglang Fri, 04 Sep 2009 16:25:20 +0000 http://carsonified.com/?p=3172#comment-14707 thank's for sharing info,..! thank’s for sharing info,..!

]]> By: Chris http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14640 Chris Thu, 03 Sep 2009 17:20:41 +0000 http://carsonified.com/?p=3172#comment-14640 Thanks for your insight. First I though this was bug fixed for Zend framework. I tried to learn and implement Zend framework one time , but gave it up. To me it's just too heavy and slow. Thanks for your insight. First I though this was bug fixed for Zend framework. I tried to learn and implement Zend framework one time , but gave it up. To me it’s just too heavy and slow.

]]> By: rob http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14605 rob Thu, 03 Sep 2009 07:07:22 +0000 http://carsonified.com/?p=3172#comment-14605 Great article, I read it on http://thatstoday.com/article/659935/speed-up-your-web-app-by-1000-with-1-line-of-sql Great article, I read it on http://thatstoday.com/article/659935/speed-up-your-web-app-by-1000-with-1-line-of-sql

]]> By: classicgames http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14598 classicgames Thu, 03 Sep 2009 02:32:31 +0000 http://carsonified.com/?p=3172#comment-14598 if you want smiler, you can do it. <a href="http://www.onlinegameshrine.com" rel="nofollow">classic games</a> if you want smiler, you can do it.
classic games

]]> By: Clinton Montague http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14595 Clinton Montague Wed, 02 Sep 2009 23:10:34 +0000 http://carsonified.com/?p=3172#comment-14595 Great attention grabbing title of the article! Wasn't exactly what I was expecting but a very interesting read none-the-less. I like scooping up morsels of information like this - adding to the debugging/optimising toolbox. Thanks! Great attention grabbing title of the article! Wasn’t exactly what I was expecting but a very interesting read none-the-less. I like scooping up morsels of information like this – adding to the debugging/optimising toolbox.

Thanks!

]]> By: JBagley http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14586 JBagley Wed, 02 Sep 2009 16:14:57 +0000 http://carsonified.com/?p=3172#comment-14586 Gotta love the link bait headline. Awesome. :) Gotta love the link bait headline. Awesome. :)

]]> By: Mariusz Nowak http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14584 Mariusz Nowak Wed, 02 Sep 2009 15:49:11 +0000 http://carsonified.com/?p=3172#comment-14584 I wonder why database server itself doesn't do this optimization. I wonder why database server itself doesn’t do this optimization.

]]> By: James Pearce http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14582 James Pearce Wed, 02 Sep 2009 15:15:50 +0000 http://carsonified.com/?p=3172#comment-14582 This is what I both love and hate about databases ;-) Love: you can make small changes to queries, indexes, clusters etc, and things improve many orders of magnitude and you're the performance hero for the day. It's very satisfying. Hate: you can rarely predict completely what those bottlenecks will be until you have lots of real data. This is partly because query engine will make decisions based on its understanding of the statistics of the data (which may not agree with your assumptions), but also because someone might have written a daft query that you didn't index for. This is what I both love and hate about databases ;-)

Love: you can make small changes to queries, indexes, clusters etc, and things improve many orders of magnitude and you’re the performance hero for the day. It’s very satisfying.

Hate: you can rarely predict completely what those bottlenecks will be until you have lots of real data. This is partly because query engine will make decisions based on its understanding of the statistics of the data (which may not agree with your assumptions), but also because someone might have written a daft query that you didn’t index for.

]]> By: Jay Paroline http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14579 Jay Paroline Wed, 02 Sep 2009 14:36:00 +0000 http://carsonified.com/?p=3172#comment-14579 If you want case insensitivity all the time, it would probably be a lot cheaper to use a case insensitive collation, at least in MySQL If you want case insensitivity all the time, it would probably be a lot cheaper to use a case insensitive collation, at least in MySQL

]]> By: Jake Stride http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14578 Jake Stride Wed, 02 Sep 2009 14:35:08 +0000 http://carsonified.com/?p=3172#comment-14578 We actually use PostgreSQL and some custom framework code. Using EXPLAIN ANALYZE is a really useful tool for optimising queries and checking ended usage. We actually use PostgreSQL and some custom framework code.

Using EXPLAIN ANALYZE is a really useful tool for optimising queries and checking ended usage.

]]> By: Krues8dr http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14570 Krues8dr Wed, 02 Sep 2009 13:14:24 +0000 http://carsonified.com/?p=3172#comment-14570 For what @Steve said above - MySQL doesn't support functional indexes, so you'll have to use a different flavor. Along those lines, though, I'd add a column to the table that's the lowercased-and-plaintext-searchable version of the column in question, properly indexed, if you're using it that often. You'll see another big performance boost from not having to do on-the-fly string manipulations. For what @Steve said above – MySQL doesn’t support functional indexes, so you’ll have to use a different flavor. Along those lines, though, I’d add a column to the table that’s the lowercased-and-plaintext-searchable version of the column in question, properly indexed, if you’re using it that often. You’ll see another big performance boost from not having to do on-the-fly string manipulations.

]]> By: idont http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14565 idont Wed, 02 Sep 2009 11:57:28 +0000 http://carsonified.com/?p=3172#comment-14565 Hi, I was surprised reading your post. I used a tool to compare the performance impact of 2 SQL queries (Explain + SHOW status). There is no difference on the MySQL (5.0.x) query side. Did you profile the 2 queries? Where is the difference? Maybe it is a MySQL server config or Zend framework issue... :( Hi,

I was surprised reading your post. I used a tool to compare the performance impact of 2 SQL queries (Explain + SHOW status). There is no difference on the MySQL (5.0.x) query side.

Did you profile the 2 queries? Where is the difference?

Maybe it is a MySQL server config or Zend framework issue… :(

]]> By: Steve Schnepp http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14558 Steve Schnepp Wed, 02 Sep 2009 09:49:45 +0000 http://carsonified.com/?p=3172#comment-14558 Just be sure to have a functional index (or something equivalent) on "lower(fieldname)". Just be sure to have a functional index (or something equivalent) on “lower(fieldname)”.

]]> By: Martin http://thinkvitamin.com/code/speed-up-your-web-app-by-1000-with-1-line-of-sql/#comment-14557 Martin Wed, 02 Sep 2009 09:38:11 +0000 http://carsonified.com/?p=3172#comment-14557 Many of us (including me) started this job by learning things step by step. There is a lot of theory behind these jobs, not only theory of more high-level technologies such as PHP, MySQL but also more low-level skills such as arithmetics and digital systems. If you don't have these study backgrounds, the methodology of development and learning from one’s mistake it's a very interesting one. And there will always be something new to learn. So thanks for this post! Many of us (including me) started this job by learning things step by step. There is a lot of theory behind these jobs, not only theory of more high-level technologies such as PHP, MySQL but also more low-level skills such as arithmetics and digital systems.
If you don’t have these study backgrounds, the methodology of development and learning from one’s mistake it’s a very interesting one. And there will always be something new to learn. So thanks for this post!

]]>