Andy D Day
A giant in digital media…
A giant in digital media…
Jul 11th
We’ve been trialling aiCache, a software caching solution, for nearly two months now. AiCache sits in front of our load balancer and caches all our static files and pages limiting the amount of traffic to our app servers and more importantly, calls to our database.
We’ve had a few teething problems while setting up and adjusting for the various foibles of our sites, but now it’s tuned up it’s really handling things well. Last week we made a link on the home page of IMDB which sent us a huge amount of traffic over a 24 hour period. AiCache handled everything that was thrown at it without batting an eye lid.
If you’ve been running out of options, trying to keep your site up, then this is a recommended solution to your problems.
Jul 3rd
The AWS platform is a mature platform and extremely secure. All interactions are via key pairs and server instances can be managed using various security groups which can be limited to only the ports that are required for the app.
2. Scalable Servers
The Amazon Elastic Compute Cloud (EC2) is the scalable server part of the service that provides on demand virtualised server instances. Instances can be based on many different server setups in either Linux or Windows flavors as well as the option to use snapshots from various vendors or the community. You can also customise a base image and store that for future use. These snapshots are called AMIs (Amazon Machine Images) and are integral for launching load balanced app servers as quickly as possible.
3. Load Balancing
Amazon has a built in load balancing solution Elastic Load Balancing which can distribute incoming traffic across your EC2 instances, automatically scaling in response to incoming traffic.
4. Storage
EBS offers persistent storage for Amazon EC2 instances. EBS volumes provide off-instance storage that persists independently from the life of an instance. Volumes are highly available, highly reliable volumes that can be leveraged as an Amazon EC2 instance’s boot partition or attached to a running Amazon EC2 instance as a standard block device. When used as a boot partition, Amazon EC2 instances can be stopped and subsequently restarted, enabling you to only pay for the storage resources used while maintaining your instance’s state.
Although Scalr has been released as an open source download, the SaaS version developed and maintained by Intridea is a stable, secure and cost effective way to manage your EC2 instances online.
Scalr monitors traffic to your app and brings up new instances to cope with it by polling each instance for a response. The health of the farm is continuously monitored and maintained. When the Load Average on a type of node goes above a configurable threshold a new node is inserted into the farm to spread the load and the cluster is reconfigured. When a node crashes a new machine of that type is inserted into the farm to replace it.
Databases are managed by maintaining a master database, that when put under heavy loads Scalr will bring up clones of the database as slaves. The app will read from the slaves freeing up resources on the master, which is often cpu bound, and allows you to make intensive queries without killing overall performance. Besides the intelligent and auto provisioning features of Scalr, it also offers a disaster recovery feature. If a database server or web service master is lost, Scalr can promote a slave server to the master service in order to provide a fault tolerant solution.
Jun 15th
Today I scored my first consultant job on odesk. In some ways it’s a return to the mentoring for startups I did in Liverpool a few years ago (I actually have a mentoring certificate on the office pin board), except that I will probably have to work harder and for less money. However, I’m looking forward to the challenge of advising other companies about putting their sites into the cloud.
This first job is for a company in Virginia USA who are looking to put their new high demand web app onto Amazon, with Scalr managing the scaling element. I have quite a bit of experience using both these tools with our set up at Giant Digital, so I will hopefully be able to offer some help to my first client.
I think the biggest hill I have to climb is making myself clear when explaining things, as it’s always difficult to second guess where someone else’s knowledge is, and then you don’t want to come across as patronising either. Also, I have a weakness of not being able to build arguments, as I tend to go for a scatter gun approach. So I’m helping that doing consulting work is going to help me tighten up my presentation skills. The other challenge I’m facing is to judge where the line is between professional and being too casual with people.
Anyway, I hope this to be the first of many projects that I can work on with clients who are looking to move onto AWS and Scalr.
Apr 10th
There are many tools available to entrepreneuers for free or very cheap that you should know about if you want to make your day more productive or improve your business. Here are a few tools that I use daily or have used to improve my online businesses.
Google have provided a whole suite of tools for business users that include group calendars, document editing and email hosting. This is a must have for any business on a budget. On setting up a domain for use with Google Apps you have a suite of online tools for your staff. The most central to this is your own company email on the Gmail platform, once you have that you can easily set up groups and mailing lists for your staff to use internally. The email server can also be used outside of the browser with Thunderbird or Outlook as well as your Blackberry or whatever. There is also a very useful group calendar available and the ability to set up a group wiki with a few clicks. While setting up your domain initially might be a little tricky for the technophobe, everything else is straight forward to use.
Not free this one, but an extremely cheap way to get dedicated hosting. If you have a busy web site and have been paying through the nose for your hosting then this could be one way of saving a lot of your monthly budget. Also known as cloud computing, hosting on Amazon’s servers will make your websites (with a little bit of work) scalable. This will mean that when your traffic grows so can your sites. If you’re not afraid to get your hands dirty with your website but you’re not a computer scientist you can pair up AWS with Scalr.net which will handle all the technical side of scaling your sites.
Open Office is an open source productivity suite that you can install directly on your computer. If you’re not comfortable with leaving everything in Google’s hands then this could be a viable alternative to purchasing a usuable copy of Microsoft’s Office. Open Office has everything you would expect from Office with wordprocessing, spreadsheet, databases, graphics and presentation packages included in the package. You can’t really get a much better software product for free.
Feb 7th
Throughout the decades that rock ‘n’ roll has ruled the earth the guitar has been the ultimate in phallic symbols. Wielded by many of the most famous men to stride the planet in the twentieth and twenty-first century, the guitar and the legendary status it can bestow upon those that have masterfully brandished it, is the ultimate weapon in the battle to pull the opposite sex.
Although many consider guitarists to play “second fiddle” to the lead singer, groupies that don’t fancy the singer will always head straight for the lead guitarist. So if you wanna tap into a bit of that ol’ sex appeal for yourself, either chick or chico, then follow these ten easy steps to “Becoming A Guitar Legend”.
1. First of all you’ll need a plank to beat. So head down your music shop and buy the cheapest one you can get. Don’t listen to guitar fetishist who’ll try and blind you with science, fuck the humbucker pickups and lowered action, what you need is something in a fetching shape and colour that you can strap round your neck. Remember to leave enough change for a cool guitar strap; ones with white lightening bolts down them are always de-rigueur shoulder belts.
2. You should now begin to practice. Don’t worry about being able to play anything just yet, it’s more important to rehearse your stance. Find a brightly lit room with a full-length mirror and hang your weapon of choice from your neck. Adjust the strap length so that your guitar nearly covers your kneecaps. IMPORTANT: do not use your guitar to cover your nipples. It may be easier to play guitar this way, but it is only necessary if you’re short-sighted or a complete gimp.
3. Once you’ve got your stance sorted, you then need to practice throwing some shapes. This should be done somewhere with a lot of space. Rehearse various pose combos until you get that “legendary” feel. You should at least be able to strum the strings with your strumming hand from a starting position above your head. The action should be circular and not angular. If you’re having problems with your technique, then you may require some extra reading. Bill & Ted’s Excellent Adventure is a good reference guide.
4. Now you’ve got the basics sorted you’ll need to learn a few chords. Although somewhat tedious, this will be necessary to join even the shittest band. The easiest chord to learn is Em (E minor), so at least learn this one. The whole Grunge genre was based on this simple chord, so its significance – despite its simplicity – should not be overlooked. Another easy chord is A, although a nerve shattering three fingers need to be coordinated to achieve this chord, the importance of doubling your repertoire cannot be emphasised enough.
5. You may have noticed at this stage that there is a certain amount of difficulty in holding down all the strings at once so that the chord rings out. Do not fret; no extra time needs to be spent perfecting the chiming chord, because step 5 is: Buy Yourself A Distortion Pedal. Distortion pedals can mask years of inexperience. Plug together your guitar, peddle and amp (if don’t have an amp you can also use hifis with phono-in sockets. If it’s your parents’ hifi, do not ask to use it first, because the answer will be “no”). Turn your pedal up to full distort and strum your full chord repertoire. By now you should at least be able to play a C chord. C is the most popular chord in pop.
6. You’re now ready to join a band. Put up “Singer, Bass Player and Drummer wanted” adverts in all your local record and musical instrument shops. Or even put one here in the Gigwise forum.
7. Once you have a full line up it’s time to hit the rehearsal rooms. Make sure you take plenty of booze, fags, pasties and fizzy drinks with you. This step is by far the most tiresome. It is also during the rehearsal that you can spot ways in which you can upstage the lead singer with rock ‘n’ roll antics. Make sure you keep a good record of his/her shortcomings; your groupie to guitarist ratio will depend on your ability to look cooler than the frontman.
8. You’re now ready to take your one-man show on the road (yeah I know you’re in a band now, but remember who’s the daddy). You need to make a recording of your band’s performance. Don’t worry about this being of too high a quality, promoters and venue owners rarely listen to them anyway, they just look at your Myspace page and see how many “fans” you have, and if they do listen to your demo, fear not, you will not be booked on the merits of your demo’s sound quality. In fact, to really jump the queue, stick a chocolate bar in the post to your favourite promoter with a link to you website sellotaped to it.
9. OK you’ve got the gig. Time to perfect your image. Root through your parent’s record collection and find something with a picture of a group on the cover. Make sure it speaks to you as an artiste. Faking things at this point could make you look daft. The perfect image is a mixture of current cool and retro classic. DO NOT wear trackies and training shoes to a gig, (unless there’s been a Madchester revivial), EVER, and do not wear your Sunday best. To be a legend you need to look the part, at this point you may wish to watch Pirates Of The Carribean for Johnny Depp‘s portrait of a rock musician. Purchase as much of your clobber second hand, this also helps you to look like you’ve been dressing this cool for ages.
10. On the big night make sure you’re fully prepared for every eventuality, remember that fucking lead singer will try and be the sexiest and the coolest onstage. Once the gig is in full swing and you’ve thrown a few rock ‘n’ roll shapes you can now smash up your guitar in an unnecessary fit, dowse it in lighter fluid and burn the bastard. Don’t worry about widdly-widdly lead breaks and playing nice tunes, no one likes those bits anyway. You’re now well on your way to becoming a legend. The groupies are now yours. You’ll need to repeat step 10 a number of times until you attain widespread acclaim, and once this is achieved you can then unleash the guitar legend stock tools of the trade; alcoholism, heroin addiction and suicide/drug overdose. If you’re still alive after five years then either quit music (you’re obviously not up to the job) or return to step 1 and repeat the process.
Feb 5th
When you’re building a business there comes a point where you have to hire some staff and obviously you want to hire the most talented people. But where to find them?
According to common belief (and Wikipedia): “Talent (in the sense of natural ability or giftedness) is not the same as skill, which is a learned process, and one which is enhanced or inhibited by an underlying talent.” That idea of talent being a god given gift that certain chosen people are born with has permeated mankind’s thinking since the beginning of time.
That’s not the case though and there seems to be a growing buzz around the idea that talent IS a learned process, it IS skill in fact. Malcolm Gladwell’s Outliers mentions the 10,000 hour rule, where experts in any given field are more than likely to have spent at least that many hours learning their trade. Likewise, Talent Is Overated by Geoff Colvin makes the point that every virtuoso spent at least 10 years of hard graft before they produced anything near a prodigious masterpiece and natural ability is down to ambitious parenting skills. There’s a great aticle on Boston.com about Grit being the real source of talent.
So how does this relate to the hiring process? Well, I’ve heard it said so many times that you need to have a degree to get a decent job nowadays, but I don’t think it’s a requirement at all. In my company there are 6 members of staff, two of which have degrees, of the three hired in the last three years, only one has a degree. There are also currently five interns who work different days, one of which doesn’t have a degree. These people are where they are despite their education.
I didn’t study at university, so that clearly influences my belief that a degree isn’t required, but more than that, when I’m hiring people, I look more at work experience than anything else on a CV. I prefer to see a number of work experience placements and internships from as early as possible on a CV than just a three year study period. I believe that the best people are the ones that are passionate about what they do and who are willing to work at getting experience anywhere they can to make their prospects as good as possible.
Of course that doesn’t preclude us hiring graduates and I would certainly encourage anyone looking to study to pursue that route, as a three year study period can equally prove that someone has passion and is willing to work hard.
What I’m looking for is people who are dogged, are willing to learn and who will go the extra mile to make something happen. And with time that equates to “talent”.
Jan 13th
Have you noticed how often our culture, particularly in the UK, is to encourage people to stick with what they’ve got instead of pushing yourself to do more? How often have you heard the old adage that birds in the hand are worth more than birds in the bush? What’s this message supposed to be telling us?
Stick with what you’ve got.
Boring.
The truth is that what you’re looking at in the bush, is worth twice as much as what you’ve got now. The safe option is to stick with what you’ve got, but meanwhile opportunity is tweeting away right in front of you.
Jan 11th
Recently a friend was speaking to me about something that they’d been thinking about doing for a long time but had never put any effort into making it happen. I could tell that they’d put a lot of thought into planning how they could achieve what they’d been thinking about. Perplexed, I asked why they had never gone through with their plan. Their answer? They were afraid that if they did, it might turn out to be a bad decision.
What’s the problem with making bad decisions?
Do the maths (or math, if you’re a yank), I can either:
Say I make 10 decision, five of them are bad and they put me into shitty situations. Four of them aren’t so bad, but I don’t get anywhere with them either, just shit decisions, no-one notices, phew. Finally, I make a half decent decision. It pays off, woot! So, I have some shit to deal with and a pay day.
We all get hit with moments of indecision, but a decision, even if it turns out to be bad is better than giving in to fear and doing nothing.
Dec 30th
I came across something weird today that might interest other online publishers. I got my regular Google alert via email about one of my sites Entertainmentwise.com, (you may be signed up for these yourself, you basically get a daily round up of any new mentions on the net that the Google Bot comes across) one of the links at the bottom of the email listed under Google Web Alert was for a page that looked like a normal Entertainmentwise page. I clicked the link thinking it would take me to my site… and it did. So I logged in and approved some comments pending, when I realised that the domain I was actually on was entertainmentsgossip.com. Thinking I was losing it I backtracked and sure enough the whole site was on this domain. How the hell did that happen?
I followed up with a quick who.is, the domain is registered to www.moniker.com a domain name registering service. Either the actual owners of this domain are hiding behind Moniker Privacy Services or Moniker have registered this domain and this is their standard practice making them a very dubious organisation indeed. Sure enough the IP address on the who is is our server. So WTF is going on here?
I’m guessing that this domain bought very recently is being pointed at our site so that they get a traffic ranking from the content we have. We rank highly on loads of celebrity search terms which would be invaluable to anyone trying to either sell on the domain or start their own celebrity site with some traffic already coming in.
Unfortunately for Entertainmentwise this would almost surely result in some kind of penalisation for our content being duplicated on another domain. So… what to do?
Fortunately there’s an easy fix for this as it only takes a quick rewrite rule in our httpd.ini file (I know, we’re on Windows!) to permanently redirect from their domain to ours, meaning they won’t earn any Google juice from this scam!
This has really got me thinking as to how common this kind of Sitejacking is. I haven’t come across this before, although I’ll be reading my Google Alerts more thoroughly from now on and a few searches with terms I would have thought would fit this kinda scam haven’t turned up a result that looks like what has happened here. So I’m naming the phenomena Sitejacking and I’d be interested to hear from anyone this might have happened to or who knows how common it is.
BTW, for anyone who eventually gets here by Googling this and is looking for a solution, this is my fix, it will be slightly different on a Linux box:
RewriteCond Host: ^www.entertainmentsgossip.com
RewriteRule (.*) http\://www\.entertainmentwise\.com$1 [I,RP]
RewriteCond Host: ^entertainmentsgossip.com
RewriteRule (.*) http\://www\.entertainmentwise\.com$1 [I,RP]