Chris Finne - Bay Area Ruby on Rails Developer for Startups

Ruby - Is a Phone Number Valid for SMS?

2011-12-05T00:00:00Z

I've used an algorithm like this in a few projects, so thought I'd post it for posterity...

I’ve used it for integrating with SMS Solutions on Aerialink and Twilio’s API

Parse American Dates with Ruby 1.9 (in Rails)

2011-10-15T00:00:00Z

UPDATE: This method no longer works as of Ruby 1.9.3. Try Jeremy Evans' GEM ruby american date that works with all 1.9.x versions.

I probably spent days peeling the onion back to this solution, so had to share to avoid others from suffering the pain.

Ruby 1.8 happily parses American dates, but Ruby 1.9 refuses. When it comes to software, I’m not an ideologue. I just want to get the job done, so I won’t pontificate, bloviate, opine or ramble on this topic. I’ll find the workaround and move on with my life.

In a Rails project running on Ruby 1.9, I need to parse date and date/time strings that have the American format of month/day/year. I needed to do this in pure Ruby cases as well as assigning Date and Date/Time strings to ActiveRecord fields.

I tried parsing the strings before they got to ActiveRecord with stuff like:

  Time.strptime(params[:start_at],"%m/%d/%Y %I:%M %p")

But there are too many places to put this and this is a fragile and error-prone approach. I then found some monkey-patching solutions to work with just date strings here and here, but this still didn’t solve the Date/Time strings.

I tried attacking the Date/Time string conversion in ActiveRecord::ConnectionAdapters::Column similar to here by overriding string_to_time and fast_string_to_time, but still had weird and inconsistent results when assigning a Date/Time string to an ActiveRecord attribute.

The final solution is of course a fraction of the code I cycled through and oh so simple, just swap the month and day if the string you are parsing looks like xx/xx/xxxx. I’m hooking in a a VERY low level, Ruby’s Date._parse()

  class Date
    class << self
      def _parse_with_american(str, comp=true)
        hash = _parse_without_american(str, comp)
        if str=~/\A(\d{1,2})\/(\d{1,2})\/(\d{4})/
          tmp = hash[:mon]
          hash[:mon] = hash[:mday]
          hash[:mday] = tmp
        end
        hash
      end
      alias_method_chain :_parse, :american
    end
  end

I’m using alias_method_chain from Rails, but if you are not using Rails, well, you’ll figure it out.

I have no idea why there is a Date.parse and a Date._parse, nor do I care at this point. I’m just glad to move on to solving real problems rather than wrestling with date/time strings.

Rails 3 to_s(:db) when database time is NOT UTC

2011-09-23T00:00:00Z

I’m upgrading a Rails application from v2.x to v3.1 and the application stores its dates in MySQL in Pacific timezone rather than UTC.

I’ve set my config/application.rb with the following settings

config.time_zone = 'Pacific Time (US & Canada)'
config.active_record.default_timezone = :local

However, I just discovered that ActiveSupport time extensions don’t really care about ActiveRecord’s default_timezone setting.

rails31>> Time.now.to_s(:db)
=> "2011-09-23 03:02:52"
rails31>> 1.second.ago.to_s(:db)
=> "2011-09-23 10:02:59"

WHAT??? I know that these are 2 different classes:

rails31>> Time.now.class
=> Time
rails31>> 1.second.ago.class
=> ActiveSupport::TimeWithZone

This is because ActiveSupport sets to UTC before doing the “to_s” which makes sense with the default Rails configuration where all dates are stored in the DB as UTC.

https://github.com/rails/rails/blob/master/activesupport/lib/active_support/time_with_zone.rb

# :db format outputs time in UTC; all others output time in local.
# Uses TimeWithZone's +strftime+, so %Z and %z work correctly.
def to_s(format = :default)
  if format == :db
    utc.to_s(format)
  elsif formatter = ::Time::DATE_FORMATS[format]
    formatter.respond_to?(:call) ? formatter.call(self).to_s : strftime(formatter)
  else
    "#{time.strftime("%Y-%m-%d %H:%M:%S")} #{formatted_offset(false, 'UTC')}" # mimicking Ruby 1.9 Time#to_s format
  end
end
alias_method :to_formatted_s, :to_s

I guess I understand this because I’m dealing with 2 different libraries: ActiveRecord vs ActiveSupport, but it sure threw me for a loop in some of my tests where I would sometimes create values with Time.now and other times with 1.day.ago and the time-zone conversion would fail the test.

My solution to this issue is to start using .to_s(:localdb) rather than .to_s(:db)

Time::DATE_FORMATS.merge!(:localdb=>"%Y-%m-%d %H:%M:%S")

rails31>> Time.now.to_s(:db)
=> "2011-09-23 02:56:34"
rails31>> Time.now.to_s(:localdb)
=> "2011-09-23 02:56:38"
rails31>> 1.second.ago.to_s(:db)
=> "2011-09-23 10:02:59"
rails31>> 1.second.ago.to_s(:localdb)
=> "2011-09-23 03:02:59"

Ruby Rails Initialize BigDecimal with commas in the String

2011-07-22T00:00:00Z

Came across a bug in the app while helping out on SpotMe.

When you create a BigDecimal, it takes a String as the argument (not a Float or Fixnum)

BigDecimal.new('99')
BigDecimal.new('44.23')

In SpotMe when someone was entering an amount for a bill or a payment, the amount might have a comma in it. The problem is that BigDecimal ignores everything to the right of the first comma it encounters

>> BigDecimal.new('1,200') == BigDecimal.new('1200')
=> false

>> BigDecimal.new('1,200') == BigDecimal.new('1')
=> true

Monkey Patch to the rescue!

>> BigDecimal.new('1,200') == BigDecimal.new('1200')
=> true

>> BigDecimal.new('1,200') == BigDecimal.new('1')
=> false

While this concept can work for just Ruby, I used Rails' alias_method_chain. I’ve read some arguments against this approach, but in the Startup world, I’m often just trying to get the job done fast, so I like to use it.

Screen Free Day

2010-10-19T00:00:00Z

A letter came home from my son’s 2nd grade class advocating a “Wellness Week” where physical activity, nutrition, etc. are emphasized. No problems there, except that they implicitly single out technology as an enemy of health.

Following is my response on the class’s Shutterfly forum:

I'll freely admit that we failed this miserably yesterday. While I understand promoting physical activity to improve health, I'm a vocal advocate against anti-technology campaigns like this. We live in the capital of technology where our local economy is driven by media, video games and computers. My own career in software was sparked as a kid when I re-programmed my video games.

Our kids should have a healthy passion for these technologies as they make learning easier, more engaging and more accessible. It is hard to get my 2 year old to play a board game, but there are many educational games on the iPad that have enough flash to keep her attention and an interface simple enough for a toddler.

I'd rather see a "handwriting-free day" where all homework and drawing is done on a computer. Handwriting is a skill that is no longer relevant in most careers and in most of life. A "book-free day" where all reading is done on a piece of technology would also be helpful. By the time our kids enter college or the workforce, there will be very few printed periodicals no more printed newspapers. The sooner our kids get used to reading and learning on devices like the iPad, Kindle and computers, the better prepared they will be for future education and employment.

It also reminds me of a great Onion post about Glowing Rectangles

Top FAILS from Apples Mac OSX

2010-09-23T00:00:00Z

Just a running list of simple concepts that Microsoft had nailed years ago, but Apple still FAILS to get.

Close Window (CMD-W) and Quit Application (CMD-Q) keys are adjacent. How many times have I mis-typed and lost all my windows in TextMate? Thank god Chrome finally implemented a feature to avoid this problem.
Can only resize a window from a single corner. Did the other 3 sides cost too much to implement?
Apple hates the keyboard – inconsistent short-cut keys and menu navigation.
the “Green circle of confusion”. I want to maximize or unmaximize a window. When I click that green circle, it seems that someone is rolling the dice to decide what should happen. This seems to have gotten better with Snow Leopard, but still…
Going from Tiger to Leopard was ok, but Leopard to Snow Leopard? What’s next? Striped Snow Leopard? (Update: ok, they release Lion. Next one better not be Snow Lion, or Desert Lion)
Snappy. I still think my old Windows XP systems had a more “snappy” / “quick” feel to the windowing environment, e.g. opening, closing, moving windows, etc.

Apple Showdown Magic Mouse vs Magic Trackpad

2010-09-04T00:00:00Z

Apple Mice

I’ve never liked Apple’s Mice (Mouses? Meeces?). They typically take an act of god to “click” and the Magic Mouse is no different. They are also usually a lot heavier than the popular models in the PC world. But the Magic Mouse came with my Mac Pro I got a few months ago and I decided to give it a shot; afterall, Apple does so many things right (with a few glaring exceptions), they always deserve a chance.

The Magic Mouse weighs in at around 100 grams with the 2 AA batteries (about 94 grams if the batteries aren’t fully charged) which I was surprised is about the same weight as one of my standard single AA battery mice from the PC world. It feels twice the weight, but scales don’t lie. There must be some Steve Jobs Faerie Dust going on here.

Apple Laptop Trackpads

I’ve had numerous Macbook Pro’s and Airs since I converted 3 years ago. I’ve loved all the trackpads and they have improved them with every model. I’ve always found laptop trackpads to be the most productive as your hand doesn’t have to leave the keyboard for many operations. So I was extremely excited when I saw the Trackpad mentions on Twitter, so I hardly looked at the price before ordering in classic Oatmeal psychology.

Apple Magic Trackpads

My first impression if the Magic Trackpad is that the area is a lot larger than I expected as I was used to the laptop-sized surfaces, but after using, the size wasn’t much of an issue.

What I did find challenging is that I had to lift my had so far to use it. Granted, it was the same distance as moving my hand to the mouse, but I was subconsciously expecting it to be as easy as the movement to the laptop trackpad.

Although I’m right handed, I mouse left-handed which is an advantage as the Apple keyboard extra keys extend pretty far to the right, which would make hand movements much farther.

So I tried aligning the Trackpad in between my hands, just below the keyboard, but the Trackpad is too big, would occasionally get brushed and its angled elevation got in the way.

The Winner – Better Touch Tool + Magic Mouse

Although it worked well on its own, I gave up on the Trackpad because it the ergonomics just didn’t fit for me. I’m using the Magic Mouse with the Better Touch Tool. This tool allows you to make the surface of the Magic Mouse behave like the Trackpad, i.e. touch-clicks. It is VERY customizable, allowing you to define what areas on the Magic Mouse correspond to what actions, e.g. left-click right-click or dead zone.

Rails Fixture Name Starts With Test

2010-08-16T00:00:00Z

I’m using Rails 2.3.5 and I have a Rails model called “Testimonial”. Whenever I run my tests, I get a funky error about ActionView::TestCase.

desktop:~/code/project chrisfinne $ ruby -Ilib:test test/unit/business_test.rb Loaded suite test/unit/business_test Started …E…. Finished in 0.311574 seconds.

1) Error: testimonials(ActionView::TestCase): TypeError: wrong argument type Class (expected Module)

I found this Lighthouse ticket that tells me that I can’t have models called Test (which I already knew) and I cannot have any fixture files that START with “test”, e.g. “testimonials.yml”. I didn’t know that when I chose the name for my class. The fix is pretty easy…

Rename the fixture file from “test/fixtures/testimonials.yml” to something else like “test/fixtures/atestimonials.yml”
Associate the fixture with the proper class in test/test_helper.rb

class ActiveSupport::TestCase



...
set_fixture_class :atestimonials => Testimonial
...

end

Indexing Sphinx on Amazon AWS EC2 With MySQL RDS and Compression

2010-06-03T00:00:00Z

I’m using Amazon’s Relational Database Service which runs MySQL 5.1 on a Large EC2 instance for me.

I have over 2 million records in a Rails application that I index with Sphinx.

Now I’m looking at MySQL Compression. Sphinx can use it with this switch from the Sphinx Docs

mysql_connect_flags = 32 # enable compression

Sphinx Indexing (to a RAM disk) w/o compression

real 15m17.159s user 14m20.330s sys 0m28.630s

Sphinx Indexing (to a RAM disk) w/ MySQL Compression:

real 15m45.433s user 14m58.080s sys 0m13.310s

So no material difference between the two.

As an aside:

Sphinx Indexing (to an EBS boot disk) w/ MySQL Compression:

real 16m0.305s user 14m56.730s sys 0m16.230s

so it looks like using the RAM disk on EC2 doesn’t affect indexing performance all that much.

MySQL Compression for Rails

In parallel I was also looking up how to enable MySQL compression in a Rails app using the MySQL gem

How to Enable MySQL Compression With Rails and the MySQL Gem

2010-06-03T00:00:00Z

While looking to optimize my Rails performance on Amazon EC2 and RDS, I wanted to experiment to see if there are any performance improvements with enabling MySQL compression in the connection protocol since with RDS, the MySQL instance is running on another machine and I’m unsure how far away that machine really is. (Spoiler: it seems to worsen performance with EC2 and RDS)

A couple years ago, I wanted to use MySQL Stored Procedures with a Rails app and found that Rails didn’t support it. The default MySQL connection from ActiveRecord didn’t have the proper flag (Mysql::CLIENT_MULTI_RESULTS) enabled to deal with the results from a stored procedure. This is discussion is currently captured in Lighthouse

It looks like the flag (Mysql::CLIENT_MULTI_RESULTS) is now enabled by default in Rails 2.3.5 (maybe a bit earlier)

If you look in: activerecord/lib/active_record/connection_adapters/mysql_adapter.rb

ActiveRecord::Base class method mysql_connection about line #73

default_flags = Mysql.const_defined?(:CLIENT_MULTI_RESULTS) ? Mysql::CLIENT_MULTI_RESULTS : 0

Do a monkey patch and bitwise OR the flags to change it to:

default_flags = Mysql::CLIENT_MULTI_RESULTS | Mysql::CLIENT_COMPRESS

(assuming your MySQL gem is installed and supports both flags like the MySQL 2.8.1 gem does)

I then did somewhat unscientific comparision with and without the flag

./script/runner ‘puts Benchmark.realtime{Business.all(:limit=>10000)}.to_s’

Results

With the patch, the test typically took 1.6 seconds. Without the patch it typically took 0.6 seconds. So it looks like the added compression adds more overhead on the CPU than what you gain in network savings when dealing with EC2 and RDS in the same availability zone.

So as I saw with MySQL compression enabled in my Sphinx setup the network bandwidth between RDS and EC2 instances isn’t the bottleneck I’m looking for.