Work the Shell - Spreading Out Numbers
September 1st, 2008 by Dave Taylor in
The past few months, we've been writing a movie trivia game with the intent of having it be a Twitter client and sporadically spit out questions on its Twitter feed of the form “The film Sunset Blvd. was released in 1943, 1946, or 1950?”
What initially seemed like the most difficult task, finding the list of films and then extracting release dates, turned out to be a manageable one through the expedient of utilizing the terrific Internet Movie Database site (imdb.com) and pushing the data through some filters and transformations.
The end result is that with a simple invocation of a script, we can generate a data file called top-250-films-with-release-dates.db that looks like this: “Sunset Blvd. | 1950” (and now you know the answer to the question in paragraph one).
Last column left off with the puzzle of generating good “adjacent” release years. That is, if we're talking about a movie like Prince Caspian, released in 2008, we want the adjacent values to be quite close—maybe 2005 and 2007. If we're talking about Rear Window, released back in 1954, we want the adjacent values to be spread out more, because offering up 1951, 1954 and 1955 is going to be more annoying and nit-picking than 1940, 1950 and 1954 or similar. See what I mean?
What we could do is simply subtract the release year from the current year, then apply some sort of multiple to tweak the delta. Then, Prince Caspian would have an “adjacency” of zero, and Rear Window would have one of 54. Let's consider dividing the value by five and using the ceiling value to see what the calculation for a half-dozen movies produces (Table 1).
Table 1. Calculating Adjacency for the Movie Trivia Game
| Title | Release Date | Adjacency | Factor |
|---|---|---|---|
| Der Untergang | 2004 | 4 | 1 |
| Metropolis | 1927 | 81 | 17 |
| Sin City | 2005 | 3 | 1 |
| Chinatown | 1974 | 34 | 7 |
| Some Like It Hot | 1959 | 49 | 10 |
That's not bad. Sin City could have incorrect year values within one year of the actual release, while Metropolis could be off by as much as 17 without most people realizing. I mean, if I asked you right now, “Did Fritz Lang's masterwork Metropolis come out in 1927, 1931 or 1947?”, would you know the answer?
This leads to an important realization: we can't have the values perfectly spaced out, so the Factor above is the upper range of a 1..Factor choice. So, the amusing Some Like It Hot can have incorrect guesses that are anywhere from one year to nine years off.
Okay, enough discussion. How do we implement this in code?
Well, we have the release date of the movie in releasedate, and we have the current year in thisyear, so here's a simple test script:
thisyear="$(date +%Y)" releasedate="$1" adjacency="$(( $thisyear - $releasedate ))" if [ $adjacency -lt 5 ] ; then factor="1" else factor="$(( $adjacency / 5 + 1 ))" fi echo "For release $releasedate we have factor = $factor"
This demonstrates an important facet of shell scripting: sometimes thinking through the solution is more time consuming than actually coding your resultant algorithm. I could share an anecdote about my boss telling me to “stop thinking and start coding” in one of my earlier jobs, but I'll skip it. Just keep in mind that thinking through solution paths is a critical step in any job.
Now that we have a way to calculate our adjacency factor for a given movie release year, let's take the next step and actually calculate possible values:
delta="$(( $RANDOM % $factor + 1))" add="$(( $RANDOM % 2 ))" if [ $add -eq 1 ] ; then closeyear="$(( $releasedate + $delta ))" else closeyear="$(( $releasedate - $delta ))" fi
That isn't too bad as a first step.
There are two problems I see with this algorithm as is, however. First, we can end up with release years in the future (that is, Iron Man could end up with a release year of 2009, which is wrong). Second, for movies released in the last five years, we also could end up with the actual release year always sandwiched in the middle once we de-dupe the results. (I hope you can see why that's the case.)
To fix the first problem, we need to add a test to ensure that the closeyear is never greater than thisyear, which is straightforward. For the second problem, I think that having a minimum delta of two, rather than one, gives us a bit more wiggle space, though any movie released in the current year is basically a gimme anyway for people who are paying even minimal attention.
Here's how I implemented these tweaks:
if [ $adjacency -lt 5 ] ; then factor="2" else factor="$(( $adjacency / 5 + 1 ))" fi
And, a bit later in the code:
if [ $closeyear -gt $thisyear ] ; then closeyear="$(( $releasedate - $delta ))" fi
That seems to work pretty well. Now when we give the script a few different release years, here's what we see:
Release Year First Five Generated Results 1962 1970, 1967, 1958, 1960, 1971 1994 1996, 1996, 1995, 1993, 1993 2002 2004, 2001, 2000, 2001, 2003 1927 1915, 1925, 1937, 1936, 1911 2008 2006, 2007, 2007, 2006, 2007
I think we can live with this—not bad at all, actually.
Now we have all the building blocks, and next month, we'll put them all together and create the movie trivia game. With luck, we'll have space to start pushing it out on Twitter too. In the meantime, if you want to sign up on Twitter for the game and watch as I develop it, follow FilmBuzz.
Special Magazine Offer -- Free Gift with Subscription
Receive a free digital copy of Linux Journal's System Administration Special Edition as well as instant online access to current and past issues. CLICK HERE for offer
Linux Journal: delivering readers the advice and inspiration they need to get the most out of their Linux systems since 1994.
Subscribe now!
The Latest
Newsletter
Featured Videos
Set up a secure virtual host in Apache
December 22nd, 2008 by Elliot Isaacson in
Setting up an https server in Apache is easy. This tutorial covers how to create and sign your ssl certificate as well as how to configure the web server.
Recently Popular
From the Magazine
January 2009, #177
It's a battle as old as time: good vs. evil. Fortunately, Linux and FOSS are on our side as we wage the battle against those who try to steal our secrets and invade our systems.
Checking your system's security is best done sooner rather than later. Test the locks with our article on security verification; find out how to use PAM to help secure your systems; use MinorFS and AppArmor to implement discretionary access control; learn more about Samba security in part III of our series; use Darknet to help detect bots and secure your systems; use the Yubikey to increase your site's security; and don't forget to lock the doors, because a cold boot attack could render your security useless if somebody has physical access to your computer.
But, we're not just about sowing the seeds of fear. We also show you how to use memcached in Rails, how to manage multiple servers efficiently, how to deploy applications easily with Capistrano, how to manage your videos with MythVideo, how to mix it up a bit (your audio that is), and even play a few games.
Delicious
Digg
Reddit
Newsvine
Technorati





Post new comment