» Create short IDs with PHP - Like Youtube or TinyURL

IDs are often numbers. Unfortunately there are only 10 digits to work with, so if you have a lot of records, IDs tend to get very lengthy. For computers that's OK. But human beings like their IDs as short as possible. So how can we make IDs shorter? Well, we could borrow characters from the alphabet as have them pose as additional numbers.... Alphabet to the rescue!

Other title options where

  • How to create unique short string IDs with PHP & MySQL
  • Or how to create IDs similar to YouTube e.g. yzNjIBEdyww

I created this function a long time ago. Time to be nice and share.

More is Less - the 'math'

The alphabet has 26 characters. That's a lot more than 10 digits. If we also distinguish upper- and lowercase, and add digits to the bunch or the heck of it, we already have (26 x 2 + 10) 62 options we can use per position in the ID.

Now of course we can also add additional funny characters to 'the bunch' like - / * & # but those may cause problems in URLs and that's our target audience for now.

OK so because there are roughly 6x more characters we will use per position, IDs will get much shorter. We can just fit a lot more data in each position.

This is basically what url shortening services do like tinyurl, is.gd, or bit.ly. But similar IDs can also be found at youtube: http://www.youtube.com/watch?v=yzNjIBEdyww

Convert your IDs

Now unlike Database servers: webservers are easy to scale so you can let them do a bit of converting to ease the life of your users, while keeping your database fast with numbers (MySQL really likes them plain numbers ; ).

To do the conversion I've written a PHP function that can translate big numbers to short strings and vice versa. I call it: alphaID.

The resulting string is not hard to decipher, but it can be a very nice feature to make URLs or directorie structures more compact and significant.

So basically:

  • when someone requests rLHWfKd
  • alphaID() converts it to 999999999999
  • you lookup the record for id 999999999999 in your database

Source

<?php
/**
 * Translates a number to a short alhanumeric version
 *
 * Translated any number up to 9007199254740992
 * to a shorter version in letters e.g.:
 * 9007199254740989 --> PpQXn7COf
 *
 * specifiying the second argument true, it will
 * translate back e.g.:
 * PpQXn7COf --> 9007199254740989
 *
 * this function is based on any2dec && dec2any by
 * fragmer[at]mail[dot]ru
 * see: http://nl3.php.net/manual/en/function.base-convert.php#52450
 *
 * If you want the alphaID to be at least 3 letter long, use the
 * $pad_up = 3 argument
 *
 * In most cases this is better than totally random ID generators
 * because this can easily avoid duplicate ID's.
 * For example if you correlate the alpha ID to an auto incrementing ID
 * in your database, you're done.
 *
 * The reverse is done because it makes it slightly more cryptic,
 * but it also makes it easier to spread lots of IDs in different
 * directories on your filesystem. Example:
 * $part1 = substr($alpha_id,0,1);
 * $part2 = substr($alpha_id,1,1);
 * $part3 = substr($alpha_id,2,strlen($alpha_id));
 * $destindir = "/".$part1."/".$part2."/".$part3;
 * // by reversing, directories are more evenly spread out. The
 * // first 26 directories already occupy 26 main levels
 *
 * more info on limitation:
 * - http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/165372
 *
 * if you really need this for bigger numbers you probably have to look
 * at things like: http://theserverpages.com/php/manual/en/ref.bc.php
 * or: http://theserverpages.com/php/manual/en/ref.gmp.php
 * but I haven't really dugg into this. If you have more info on those
 * matters feel free to leave a comment.
 *
 * @author  Kevin van Zonneveld <kevin@vanzonneveld.net>
 * @author  Simon Franz
 * @author  Deadfish
 * @copyright 2008 Kevin van Zonneveld (http://kevin.vanzonneveld.net)
 * @license   http://www.opensource.org/licenses/bsd-license.php New BSD Licence
 * @version   SVN: Release: $Id: alphaID.inc.php 344 2009-06-10 17:43:59Z kevin $
 * @link    http://kevin.vanzonneveld.net/
 *
 * @param mixed   $in    String or long input to translate
 * @param boolean $to_num  Reverses translation when true
 * @param mixed   $pad_up  Number or boolean padds the result up to a specified length
 * @param string  $passKey Supplying a password makes it harder to calculate the original ID
 *
 * @return mixed string or long
 */
function alphaID($in, $to_num = false, $pad_up = false, $passKey = null)
{
  $index = "abcdefghijklmnopqrstuvwxyz0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZ";
  if ($passKey !== null) {
    // Although this function's purpose is to just make the
    // ID short - and not so much secure,
    // with this patch by Simon Franz (http://blog.snaky.org/)
    // you can optionally supply a password to make it harder
    // to calculate the corresponding numeric ID
 
    for ($n = 0; $n<strlen($index); $n++) {
      $i[] = substr( $index,$n ,1);
    }
 
    $passhash = hash('sha256',$passKey);
    $passhash = (strlen($passhash) < strlen($index))
      ? hash('sha512',$passKey)
      : $passhash;
 
    for ($n=0; $n < strlen($index); $n++) {
      $p[] =  substr($passhash, $n ,1);
    }
 
    array_multisort($p,  SORT_DESC, $i);
    $index = implode($i);
  }
 
  $base  = strlen($index);
 
  if ($to_num) {
    // Digital number  <<--  alphabet letter code
    $in  = strrev($in);
    $out = 0;
    $len = strlen($in) - 1;
    for ($t = 0; $t <= $len; $t++) {
      $bcpow = bcpow($base, $len - $t);
      $out   = $out + strpos($index, substr($in, $t, 1)) * $bcpow;
    }
 
    if (is_numeric($pad_up)) {
      $pad_up--;
      if ($pad_up > 0) {
        $out -= pow($base, $pad_up);
      }
    }
    $out = sprintf('%F', $out);
    $out = substr($out, 0, strpos($out, '.'));
  } else {
    // Digital number  -->>  alphabet letter code
    if (is_numeric($pad_up)) {
      $pad_up--;
      if ($pad_up > 0) {
        $in += pow($base, $pad_up);
      }
    }
 
    $out = "";
    for ($t = floor(log($in, $base)); $t >= 0; $t--) {
      $bcp = bcpow($base, $t);
      $a   = floor($in / $bcp) % $base;
      $out = $out . substr($index, $a, 1);
      $in  = $in - ($a * $bcp);
    }
    $out = strrev($out); // reverse
  }
 
  return $out;
}
Get from GitHub

Example

Running:

alphaID(9007199254740989);

will return 'PpQXn7COf' and:

alphaID('PpQXn7COf', true);

will return '9007199254740989'

Easy right?

More features

  • There also is an optional third argument: $pad_up. This enables you to make the resulting alphaId at least X characters long.
  • You can support even more characters (making the resulting alphaID even smaller) by adding characters to the $index var at the top of the function body.

Bonus

Thanks to some wonderful contributions in the comment section, here are some interesting updates & additions:

Pro tip

You may want to remove vouwels (a, e, o, u, i) from $index as to avoid combinations that result in: 'penis' or other dirty words that could get your customers upset.

You can also use the $pad_up argument to enforce a minimum length of 5 characters as to avoid: 'nsfw' and 'wtf'.

Thanks to William for pointing this out ;)

Postgres Implementation

Thanks to William as well:

CREATE OR REPLACE FUNCTION string_to_bits(input_text TEXT)
RETURNS TEXT AS $$
DECLARE
output_text TEXT;
i INTEGER;
BEGIN
output_text := '';
 
 
FOR i IN 1..char_length(input_text) LOOP
output_text := output_text || ascii(substring(input_text FROM i FOR 1))::bit(8);
END LOOP;
 
 
RETURN output_text;
END;
$$ LANGUAGE plpgsql;
 
 
CREATE OR REPLACE FUNCTION id_to_sid(id INTEGER)
RETURNS TEXT AS $$
DECLARE
output_text TEXT;
i INTEGER;
INDEX TEXT[];
bits TEXT;
bit_array TEXT[];
input_text TEXT;
BEGIN
input_text := id::TEXT;
output_text := '';
INDEX := string_to_array('0,d,A,3,E,z,W,m,D,S,Q,l,K,s,P,b,N,c,f,j,5,I,t,C,i,y,o,G,2,r,x,h,V,J,k,-,T,w,H,L,9,e,u,X,p,U,a,O,v,4,R,B,q,M,n,g,1,F,6,Y,_,8,7,Z', ',');
 
bits := string_to_bits(input_text);
 
IF length(bits) % 6 <> 0 THEN
bits := rpad(bits, length(bits) + 6 - (length(bits) % 6), '0');
END IF;
 
FOR i IN 1..((length(bits) / 6)) LOOP
IF i = 1 THEN
bit_array[i] := substring(bits FROM 1 FOR 6);
ELSE
bit_array[i] := substring(bits FROM 1 + (i - 1) * 6 FOR 6);
END IF;
 
output_text := output_text || INDEX[bit_array[i]::bit(6)::integer + 1];
END LOOP;
 
 
RETURN output_text;
END;
$$ LANGUAGE plpgsql;

Java Implementation

Thanks to Ant Kutschera there also is a Java version. Click on his name for the external link to it.

JavaScript Implementation

Thanks to Even Simon, there's a JavaScript implementation. You will also find PHP version there, that implements the encode & decode functions as separate methods in a class.

/**
 *  Javascript AlphabeticID class
 *  (based on a script by Kevin van Zonneveld <kevin@vanzonneveld.net>)
 *
 *  Author: Even Simon <even.simon@gmail.com>
 *
 *  Description: Translates a numeric identifier into a short string and backwords.
 *
 *  Usage:
 *    var str = AlphabeticID.encode(9007199254740989); // str = 'fE2XnNGpF'
 *    var id = AlphabeticID.decode('fE2XnNGpF'); // id = 9007199254740989;
 **/
 
var AlphabeticID = {
  index:'abcdefghijklmnopqrstuvwxyz0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZ',
 
  /**
   *  <a href="http://twitter.com/function">@function</a> AlphabeticID.encode
   *  <a href="http://twitter.com/description">@description</a> Encode a number into short string
   *  <a href="http://twitter.com/param">@param</a> integer
   *  <a href="http://twitter.com/return">@return</a> string
   **/
  encode:function(_number){
    if('undefined' == typeof _number){
      return null;
    }
    else if('number' != typeof(_number)){
      throw new Error('Wrong parameter type');
    }
 
    var ret = '';
 
    for(var i=Math.floor(Math.log(parseInt(_number))/Math.log(AlphabeticID.index.length));i>=0;i--){
      ret = ret + AlphabeticID.index.substr((Math.floor(parseInt(_number) / AlphabeticID.bcpow(AlphabeticID.index.length, i)) % AlphabeticID.index.length),1);
    }
 
    return ret.reverse();
  },
 
  /**
   *  <a href="http://twitter.com/function">@function</a> AlphabeticID.decode
   *  <a href="http://twitter.com/description">@description</a> Decode a short string and return number
   *  <a href="http://twitter.com/param">@param</a> string
   *  <a href="http://twitter.com/return">@return</a> integer
   **/
  decode:function(_string){
    if('undefined' == typeof _string){
      return null;
    }
    else if('string' != typeof _string){
      throw new Error('Wrong parameter type');
    }
 
    var str = _string.reverse();
    var ret = 0;
 
    for(var i=0;i<=(str.length - 1);i++){
      ret = ret + AlphabeticID.index.indexOf(str.substr(i,1)) * (AlphabeticID.bcpow(AlphabeticID.index.length, (str.length - 1) - i));
    }
 
    return ret;
  },
 
  /**
   *  <a href="http://twitter.com/function">@function</a> AlphabeticID.bcpow
   *  <a href="http://twitter.com/description">@description</a> Raise _a to the power _b
   *  <a href="http://twitter.com/param">@param</a> float _a
   *  <a href="http://twitter.com/param">@param</a> integer _b
   *  <a href="http://twitter.com/return">@return</a> string
   **/
  bcpow:function(_a, _b){
    return Math.floor(Math.pow(parseFloat(_a), parseInt(_b)));
  }
};
 
/**
 *  <a href="http://twitter.com/function">@function</a> String.reverse
 *  <a href="http://twitter.com/description">@description</a> Reverse a string
 *  <a href="http://twitter.com/return">@return</a> string
 **/
String.prototype.reverse = function(){
  return this.split('').reverse().join('');
};

Python Implementation

Thanks to wessite, there's a Python implementation.

ALPHABET = "bcdfghjklmnpqrstvwxyz0123456789BCDFGHJKLMNPQRSTVWXYZ"
BASE = len(ALPHABET)
MAXLEN = 6
 
def encode_id(self, n):
 
    pad = self.MAXLEN - 1
    n = int(n + pow(self.BASE, pad))
 
    s = []
    t = int(math.log(n, self.BASE))
    while True:
        bcp = int(pow(self.BASE, t))
        a = int(n / bcp) % self.BASE
        s.append(self.ALPHABET[a:a+1])
        n = n - (a * bcp)
        t -= 1
        if t < 0: break
 
    return "".join(reversed(s))
 
def decode_id(self, n):
 
    n = "".join(reversed(n))
    s = 0
    l = len(n) - 1
    t = 0
    while True:
        bcpow = int(pow(self.BASE, l - t))
        s = s + self.ALPHABET.index(n[t:t+1]) * bcpow
        t += 1
        if t > l: break
 
    pad = self.MAXLEN - 1
    s = int(s - pow(self.BASE, pad))
 
    return int(s)

Python Implementation

Thanks to Andy Li, there's a HaXe implementation.

/**
 *  HaXe version of AlphabeticID
 *  Author: Andy Li <andy@onthewings.net>
 *  ported from...
 *
 *  Javascript AlphabeticID class
 *  Author: Even Simon <even.simon@gmail.com>
 *  which is based on a script by Kevin van Zonneveld <kevin@vanzonneveld.net>)
 *
 *  Description: Translates a numeric identifier into a short string and backwords.
 *  http://kevin.vanzonneveld.net/techblog/article/create_short_ids_with_php_like_youtube_or_tinyurl/
 **/
 
class AlphaID {
    static public var index:String = 'abcdefghijklmnopqrstuvwxyz0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZ';
 
    static public function encode(_number:Int):String {        
        var strBuf = new StringBuf();
 
        var i = 0;
        var end = Math.floor(Math.log(_number)/Math.log(index.length));
        while(i <= end) {
            strBuf.add(index.charAt((Math.floor(_number / bcpow(index.length, i++)) % index.length)));
        }
 
        return strBuf.toString();
    }
 
    static public function decode(_string:String):Int {
        var str = reverseString(_string);
        var ret = 0;
 
        var i = 0;
        var end = str.length - 1;
        while(i <= end) {
            ret += Std.int(index.indexOf(str.charAt(i)) * (bcpow(index.length, end-i)));
            ++i;
        }
 
        return ret;
    }
 
    inline static private function bcpow(_a:Float, _b:Float):Float {
        return Math.floor(Math.pow(_a, _b));
    }
 
    inline static private function reverseString(inStr:String):String {
        var ary = inStr.split("");
        ary.reverse();
        return ary.join("");
    }
}

You Probably Shouldn't Follow Me


Like this Article?

I'd appreciate it if you leave a comment, spread the word, or consider a small donation


tags: php, programming, mysql, database, youtube, tinyurl
category: Programming
read: 73,377 times

Add comment

(required, shown)(required, not shown)for syntax highlighting

[CODE="Javascript"]
your_code_here();
[/CODE]

Replace "Javascript"
with "php", "text", etc.
code (to make sure you are not a spammer)

 Track replies: rss feed comments feed

Comments

#66. Renox on 13 May 2012

Gravatar.com: Renox@ Leander
nice ^^
typical for php btw.
Someone implements a big function of something, that already exists.

#65. Leander on 09 May 2012

Gravatar.com: Leanderto me this seems quite complicated.
why not just express your integer with a base of lets say 36?

$testId = 9999999999999;
$alphaId = base_convert($testId, 10, 36);
$originalInteger = intval($alphaId, 36);

#64. SaudSattar on 24 March 2012

Gravatar.com: SaudSattarGood

#63. Lan on 19 February 2012

Gravatar.com: Lan@ Dan: 238328

You can calculate this by
(length of $index) ^ (number of places)

... [more] so 62^3 = 238,328

Using 4 places would give you 14,776,336 numbers to work with

#62. wouter2512 on 16 February 2012

Gravatar.com: wouter2512@Alessandro

That aren't duplicates, but rather your checking is not in order. PHP interprets the values 0x... as hexadecimal and searches for the corresponding value. And as it happends it exists already... It also happens with strings starting with 1e... and so on.

#61. Necessity on 09 February 2012

Gravatar.com: NecessityWhat inputs am I allowed to use if my output must be exactly a 6 digit number?

#60. Rafique on 03 February 2012

Gravatar.com: RafiqueThnks alot bro!! it helps alot!! :)

#59. Romas on 17 January 2012

Gravatar.com: RomasC# code:

class ShortId
{
public string Alphabet = "abcdefghijklmnopqrstuvwxyz0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZ";
... [more]
public string Encode(Int64 Number)
{
string result = String.Empty;
for (int i = (int)Math.Floor(Math.Log(Number) / Math.Log(Alphabet.Length)); i >= 0; i--)
{
result += Alphabet.Substring((int)(Math.Floor(Number / BcPow(Alphabet.Length, i)) % Alphabet.Length), 1);
}
return ReverseString(result);
}

public Int64 Decode(string Id)
{
string str = ReverseString(Id);
Int64 result = 0;
int end = str.Length - 1;
for (int i = 0; i <= end; i++)
{
result = result + (Int64)(Alphabet.IndexOf(str.Substring(i, 1)) * BcPow(Alphabet.Length, end - i));
}
return result;
}

public double BcPow(double _a, double _b)
{
return Math.Floor(Math.Pow(_a, _b));
}

public string ReverseString(string s)
{
char[] arr = s.ToCharArray();
Array.Reverse(arr);
return new string(arr);
}
}

#58. Alessandro on 16 November 2011

Gravatar.com: AlessandroHi, thank you for your nice script, i'm testing it with this script:

$test=Array();
for($i=1000000;$i<9007199254740992;$i++){
$id = alphaID($i, false, 8);
if (in_array($id, $test)) {
echo "Collision detected at $i with id $idn";
}
if($i % 1000 == 0){
echo "i = $in";
}
array_push($test,$id);
}


and it seems that there are some collisions all starting with 0X, is there a starting number that can be considered "safe"? Because you won't create an id that corrispond to 2 rows in the db.

Best Regards

#57. dahuda on 03 November 2011

Gravatar.com: dahudaCode seems nice, will use it .. thnx in advance man. keep up the good work, it is appreciated..

#56. Tim on 23 September 2011

Gravatar.com: TimWith smaller ids and padding this creates not so random hashes. Anyway around this?

2 = dbbbc
3 = fbbbc

#55. Neil on 11 August 2011

Gravatar.com: NeilI also remove lowercase L, the number 1, the letter O and Zero, because they can be ambiguous if you need to physically type them.

#54. sid on 07 July 2011

Gravatar.com: sidHow do you think duplicate alphaid's can be avoided without correlating with a auto_increment field ?

#53. Rony on 28 June 2011

Gravatar.com: RonyReally great function. Saved me a lot of coding. :)
Thanks...

#52. sylvester javed on 21 June 2011

Gravatar.com: sylvester javedthe best viewer page

#51. sameer zafar on 11 June 2011

Gravatar.com: sameer zafarrehgsfgfh

#50. Dan on 18 May 2011

Gravatar.com: DanThat's a great function.
How many combinations are if I choose the string to be of length 3?

Is it more than 1 million?
Or how could I calculate.
... [more]
Thanks.

#49. Kevin on 17 April 2011

Twitter.com: kvz@ franfran: That's expected behavior. I guess if you take out the part where I reverse the string, it could work without knowing the padlength.

@ chrischris: I'll need to look into that

#48. franfran on 11 April 2011

Gravatar.com: franfranThanks, this is a nice function. However, just found out that you must know the $pad_up value to decode. So the $pad_up is somehow become part of the $passKey.

If we want to encode a string with minimum length:

alphaID(9007199254740989, false, 6);


will return '9QFqnGSNRf'

alphaID('9QFqnGSNRf', true);


will get the WRONG thing 9007199599766240

You can only get back the original number if you know the $pad_up

alphaID('9QFqnGSNRf', true, 6);


will return 9007199254740989

#47. chrischris on 07 April 2011

Gravatar.com: chrischrisHi Kevin,

Thanks for a great script. Thanks!

Have you considered using the input as a string instead of an integer to overcome the limitation of a large integer in PHP?

"18446744073709551615" instead of 18446744073709551615.

I've been playing around with this encryption class by Tony Marston (http://www.tonymarston.co.uk/php-mysql/encryption.html), and it seems it works even with 18446744073709551615.

But the trick is you have to make sure the input is a string. If it's integer and the number is very large, PHP will convert it into a scientific notation e.g. 1.84467440E+12 first, and the encryption class will use this scientific notation instead of the actual number representation for conversion.

And you'd need to tweak the class so the resulted data is URL friendly. I just removed all the funny characters, except an empty space " " because it's used for padding. And then I added a code to replace a " " with a "_" to make it URL friendly. When I need to decode it, I just replace "_" back to " " before decoding it. It seems it works fine.

--

As for your alphaID script, is there a limitation with $pad_up? When I set it to 10, some numbers don't get converted back correctly:

for($i = 0; $i < 100; $i++){
$alpha_id = alphaID($i, false, 10, "passtest");
$int_id = alphaID($alpha_id, true, 10, "passtest");
print "$i|$alpha_id|$int_id<br>";
}
 
Results:
 
Original int|alphaID|Converted int back
 
0|2222222229|0
1|2222222229|0
2|A222222229|2
3|R222222229|4
4|R222222229|4
5|R222222229|4
6|0222222229|6
7|W222222229|8
8|W222222229|8
9|W222222229|8


Thanks.

#46. devashish gupta on 13 March 2011

Gravatar.com: devashish guptai like.........

#45. Kevin on 10 March 2011

Twitter.com: kvz@ John Smith: But then how would you encode 0? ; )

If you'll never use zeros, I guess an easy "fix" for that would be in your call: alphaID($mynumber-1).
Don't forget to reverse the decrement when you're decoding as well.

#44. John Smith on 10 March 2011

Gravatar.com: John SmithThanks for sharing! Everything works perfect, except for that when the ID is 1, the code uses "b" not "a", and when the ID is 63, it uses "bb" not "aa". Is there any fix for that?

#43. Kevin on 04 March 2011

Twitter.com: kvz@ cdub: Thanks : ) Url doesn't seem to work anymore though :/

@ Iain: As stated in the function's comments, it's limited to relatively small numbers (9007199254740989 on 32bits systems). If you need anything bigger you'd best make some adjustments using the bc extension in PHP

#42. Iain on 24 February 2011

Gravatar.com: IainI like this very much. But it gives an error result with large number. Here is an example:

$num = 18446744073709551615; // mysql unsigned int
 
// print MOrkgbArGYv
$converted = alphaID($num);
 
// print 18446744073709551616
echo alphaID($converted, true);


Notice there is a slight difference there on the result. Anyone can help on this issue?

Thanks.

#41. cdub on 11 January 2011

Gravatar.com: cdubOne more thing... I found an ASP.NET MVC url shortener similar to yours and thought it might be useful to link here, http://blog.andresays.org/2010/11/simple-url-shortening-with-rolling-strings/

#40. Ganesh on 10 January 2011

Gravatar.com: Ganeshshall we use base_convert?

#39. cdub on 10 January 2011

Gravatar.com: cdubThanks so much! I've done a lot of research on URL shorteners and I like you're implementation the best.

#38. Julien on 30 December 2010

Gravatar.com: JulienI tried PHP and Python solution but the short ID created with int ID are not the same.

#37. Martin on 11 November 2010

Gravatar.com: MartinVery nice.

#36. Kevin on 10 June 2010

Twitter.com: kvz@ Stephen: Not that I mind uniform results, but that's still an excellent tip I imagine many will find very useful. Thanks!

@ Tim: You're note supposed to do anything. But I would just use numeric indexes to keep the database speedy, and use appservers (easiest to scale in any infra) to care care of the conversion. If you don't want small alphaIds like 'c', try the pad argument.

#35. Tim on 23 May 2010

Gravatar.com: TimCould you give an example of putting it all together with PHP/mySQL, including table structure?

I'm building a new site and don't have big numbers yet. So if I set my ID column to make up a big number, such as INT(16) unsigned zerofill and INSERT a record, I get 0000000000000001 as an id. If I return that using the alphaID() function I get 'c'. Hardly usable. :)

Are we supposed to add a second id column, alpha_id INT(16), instead and have PHP generate a random number, then INSERT IGNORE and hope that the number already isn't in the db? Or are we supposed to store the alphaID "PpQXn7COf" in the db and lookup on that? If so, doesn't that then negate the speed of a numerical lookup? Also, that just goes back to having PHP generate a rand number, right?

#34. Stephen on 22 May 2010

Gravatar.com: StephenGr8 script.

I thought I might add to it. If you have a short number and the pad_up say alphaID('9', false, 7, 'passkeys') you get a number like 366666P.
to avoid having something uniform like this I multiply the

... [more] (Digital number -->> alphabet letter code)

by a large prime number.. eg: $in = $in * 89527;

and you need to do the rev also so at the end of

(Digital number <<-- alphabet letter code):

$out = $out / 89527;

This will produce a more cryptic output like YDPH66P.

As for the prime number I just went and picked one from http://www.mathsisfun.com/numbers/prime-number-lists.html

#33. Kevin on 15 May 2010

Twitter.com: kvz@ SD (Aspherical): No problem

@ esco: Yeah you need the bcmath stuff.

@ Webdesigner: while it was not intended to encrypt or hide the actual id so much as to make it smaller/easier to read, Simon Franz patched the function to support passwords. the 4th argument.

#32. esco on 07 May 2010

Gravatar.com: escoI had to install bcmath extension. Works fine now. If anyone has the same problem, check your php configuration.

#31. Webdesigner on 02 May 2010

Gravatar.com: WebdesignerHow to add a secure Passwort, so that it's harder to get the ID from the String?

#30. esco on 01 May 2010

Gravatar.com: escoNo return when I try for example

echo alphaID(238328, false);

When I try to debug a bit amateuristic, I think it breaks at:
$bcp = bcpow($base, $t);

Can someone help?

#29. SD (Aspherical) on 30 April 2010

Gravatar.com: SD (Aspherical)Thanks so much for posting this, I used your digital number to alphabet letter encoding code section to build a custom link shortener that I use when Twittering my photoblog updates. Works like a charm!

Right now, I just put the encoded link in a database table, but I might explore using the decoder in the future.

#28. Kevin on 24 April 2010

Twitter.com: kvz@ Andy Li: Awesome, Added! :)

#27. Thiet ke website on 19 April 2010

Gravatar.com: Thiet ke websiteThanks for the nice code, i'm very interesting :)

#26. Andy Li on 06 April 2010

Gravatar.com: Andy LiI made a haXe version, which can be compiled to swf/js/php/c++/neko :)

Here it is:
http://gist.github.com/358018

#25. Kevin on 04 April 2010

Twitter.com: kvz@ wessite: How cool is that?? Thanks, Added! : )

#24. wessite on 31 March 2010

Gravatar.com: wessiteThanks for this article, the code was very useful!
I needed this in python to use on Google Appengine, here's the code:

ALPHABET = "bcdfghjklmnpqrstvwxyz0123456789BCDFGHJKLMNPQRSTVWXYZ"
BASE = len(ALPHABET)
MAXLEN = 6

def encode_id(self, n):

pad = self.MAXLEN - 1
n = int(n + pow(self.BASE, pad))
 
s = []
t = int(math.log(n, self.BASE))
while True:
bcp = int(pow(self.BASE, t))
a = int(n / bcp) % self.BASE
s.append(self.ALPHABET[a:a+1])
n = n - (a * bcp)
t -= 1
if t < 0: break

return "".join(reversed(s))

def decode_id(self, n):

n = "".join(reversed(n))
s = 0
l = len(n) - 1
t = 0
while True:
bcpow = int(pow(self.BASE, l - t))
s = s + self.ALPHABET.index(n[t:t+1]) * bcpow
t += 1
if t > l: break
 
pad = self.MAXLEN - 1
s = int(s - pow(self.BASE, pad))
 
return int(s)

#23. Kevin on 27 March 2010

Twitter.com: kvz@ William: Hey there! Good stuff man! I've updated the article to reflect your awesome contributions!

#22. William on 27 March 2010

Gravatar.com: WilliamHey Kevin and others!

In my last comment I suggested to remove all vowels from $index to prevent unfriendly / dirty words. With that in mind I would like to add another suggestion: to make the string at least 5 characters long to prevent getting id's like: 'wtf', 'nsb', 'nsfw', etc ;-)

I also made a PostgreSQL version of Kevin's script :-)
... [more]
It doesn't create a random unique string, but it will convert numbers to a string. It's an edited version of base64 encoding (URL save version without characters like: '/' and '=' ).

I hope you people find any use for it.

<?php

CREATE OR REPLACE FUNCTION string_to_bits(input_text TEXT)
RETURNS TEXT AS $$
DECLARE
output_text TEXT;
i INTEGER;
BEGIN
output_text := '';


FOR i IN 1..char_length(input_text) LOOP
output_text := output_text || ascii(substring(input_text FROM i FOR 1))::bit(8);
END LOOP;


return output_text;
END;
$$ LANGUAGE plpgsql;


CREATE OR REPLACE FUNCTION id_to_sid(id INTEGER)
RETURNS TEXT AS $$
DECLARE
output_text TEXT;
i INTEGER;
index TEXT[];
bits TEXT;
bit_array TEXT[];
input_text TEXT;
BEGIN
input_text := id::TEXT;
output_text := '';
index := string_to_array('0,d,A,3,E,z,W,m,D,S,Q,l,K,s,P,b,N,c,f,j,5,I,t,C,i,y,o,G,2,r,x,h,V,J,k,-,T,w,H,L,9,e,u,X,p,U,a,O,v,4,R,B,q,M,n,g,1,F,6,Y,_,8,7,Z', ',');

bits := string_to_bits(input_text);

IF length(bits) % 6 <> 0 THEN
bits := rpad(bits, length(bits) + 6 - (length(bits) % 6), '0');
END IF;

FOR i IN 1..((length(bits) / 6)) LOOP
IF i = 1 THEN
bit_array[i] := substring(bits FROM 1 FOR 6);
ELSE
bit_array[i] := substring(bits FROM 1 + (i - 1) * 6 FOR 6);
END IF;

output_text := output_text || index[bit_array[i]::bit(6)::integer + 1];
END LOOP;


return output_text;
END;
$$ LANGUAGE plpgsql;

?>

Have a nice day!

William

#21. Kevin on 24 March 2010

Twitter.com: kvz@ William: Fair point : ) Thanks for this.

@ Even Simon: Good stuff man!

@ both: I'll update the article with clear references to your comments soon

#20. Even Simon on 23 March 2010

Gravatar.com: Even SimonHi there,

I've used your code for my website, let me say this is some excellent work. Anyhow I also needed the same functionality on the client-side (JavaScript) so I had to write my own. Here it is:

/**
* Javascript AlphabeticID class
* (based on a script by Kevin van Zonneveld <kevin@vanzonneveld.net>)
*
* Author: Even Simon <even.simon@gmail.com>
*
* Description: Translates a numeric identifier into a short string and backwords.
*
* Usage:
* var str = AlphabeticID.encode(9007199254740989); // str = 'fE2XnNGpF'
* var id = AlphabeticID.decode('fE2XnNGpF'); // id = 9007199254740989;
**/

 
var AlphabeticID = {
index:'abcdefghijklmnopqrstuvwxyz0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZ',
 
/**
* @function AlphabeticID.encode
* @description Encode a number into short string
* @param integer
* @return string
**/

encode:function(_number){
if('undefined' == typeof _number){
return null;
}
else if('number' != typeof(_number)){
throw new Error('Wrong parameter type');
}
 
var ret = '';
 
for(var i=Math.floor(Math.log(parseInt(_number))/Math.log(AlphabeticID.index.length));i>=0;i--){
ret = ret + AlphabeticID.index.substr((Math.floor(parseInt(_number) / AlphabeticID.bcpow(AlphabeticID.index.length, i)) % AlphabeticID.index.length),1);
}
 
return ret.reverse();
},
 
/**
* @function AlphabeticID.decode
* @description Decode a short string and return number
* @param string
* @return integer
**/

decode:function(_string){
if('undefined' == typeof _string){
return null;
}
else if('string' != typeof _string){
throw new Error('Wrong parameter type');
}
 
var str = _string.reverse();
var ret = 0;
 
for(var i=0;i<=(str.length - 1);i++){
ret = ret + AlphabeticID.index.indexOf(str.substr(i,1)) * (AlphabeticID.bcpow(AlphabeticID.index.length, (str.length - 1) - i));
}
 
return ret;
},
 
/**
* @function AlphabeticID.bcpow
* @description Raise _a to the power _b
* @param float _a
* @param integer _b
* @return string
**/

bcpow:function(_a, _b){
return Math.floor(Math.pow(parseFloat(_a), parseInt(_b)));
}
};
 
/**
* @function String.reverse
* @description Reverse a string
* @return string
**/

String.prototype.reverse = function(){
return this.split('').reverse().join('');
};


Plus I've rewritten your PHP function into a PHP class to make it more suitable for my code:

<?php
class AlphabeticID{
const index = "abcdefghijklmnopqrstuvwxyz0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZ";
 
public static function encode($number){
if(!isset($number)){
return null;
}
 
$base = strlen(self::index);
$out = "";
for ($t = floor(log($number, $base)); $t >= 0; $t--) {
$bcp = bcpow($base, $t);
$a = floor($number / $bcp) % $base;
$out = $out . substr(self::index, $a, 1);
$number = $number - ($a * $bcp);
}
$out = strrev($out);
return $out;
}
 
public static function decode($string){
$base = strlen(self::index);
$string = strrev($string);
$out = 0;
$len = strlen($string) - 1;
 
for ($t = 0; $t <= $len; $t++){
$bcpow = bcpow($base, $len - $t);
$out = $out + strpos(self::index, substr($string, $t, 1)) * $bcpow;
}
 
$out = sprintf('%F', $out);
$out = substr($out, 0, strpos($out, '.'));
return $out;
}
}
?>


Have a nice day. $))

-Simon

#19. William on 22 March 2010

Gravatar.com: WilliamNice script!

I got 1 small advise.. Remove all vouwels (a, e, o, u, i) from $index, otherwise one day one of your customers will ask you why his username (or whatever) is 'penis' (or another unfriendly/dirty word) ;-).

#18. Kevin on 21 February 2010

Twitter.com: kvz@ Ant Kutschera: Cool to see someone tackling the exact same problem in a completely different part of the world & programming community :) Thanks for leaving a note man.

#17. Ant Kutschera on 13 February 2010

Gravatar.com: Ant Kutscherahi,

ive done the same thing independently using java.

http://blog.maxant.co.uk/pebble/2010/02/02/1265138340000.html
... [more]
im not sure what this type of encoding is really called...

another application for it is where you want to provide users with a pin which they can share among friends. but you dont want anyone to guess the pin. so you take your primary key for the relevant thing which is being shared, and append a 4 digit random number the the end, before encoding your big number. the PIN you distribute is the encoded shorter version.

#16. Kevin on 07 January 2010

Twitter.com: kvz@ Catalin: Good point. With my distro it's default, but that may not be the case for everybody. Thanks for sharing.

#15. Catalin on 17 December 2009

Gravatar.com: Catalinphp must be compiled with --enable-bcmath configure option for this to work.

#14. Kevin on 13 December 2009

Twitter.com: kvz@ Deadfish: Wow great stuff! I've fixed the bug thanks!

http://github.com/kvz/kvzlib/commit/1bf020eb82fcfac67353219817b3813e2df325e5

#13. Deadfish on 08 December 2009

Gravatar.com: DeadfishA proper bug fix...

replace log10($in) / log10($base) with log10($in, $base) and $a = floor($in / $bcp) with $a = floor($in / $bcp) % $base. That will fix the bug with alphaID(238328);

#12. Deadfish on 07 December 2009

Gravatar.com: DeadfishThe only example I can find of this bug happening is alphaID(238328);

#11. Deadfish on 07 December 2009

Gravatar.com: DeadfishI think there is a bug in your code. I believe it should not be... $base = strlen($index); but $base = strlen($index) - 1; or else during encoding when it calls substr($index, $a, 1) $a would be the character after the last character. Apart from that great code :D

#10. Kevin on 25 October 2009

Twitter.com: kvz@ Tanzmusik: Well it was never the goal of this function to be used as a security measure, but Simon Franz was kind enough to provide a patch for that nonetheless:

http://github.com/kvz/kvzlib/commit/323e9c3bb3e489150bdddea51a785e1e931003d7

#9. Tanzmusik on 11 October 2009

Gravatar.com: Tanzmusikwow, just great.
The only improvement i mean is to modify the code by adding or removing some letters before use. If you do not modify, then everyone else can reveal your primary key structure.

#8. Kevin on 09 October 2009

Twitter.com: kvz@ BnoL: This is not intended for security. Pure usability. If you want security you should probably use a lookup table or use UUIDS for records directly.

#7. BnoL on 17 September 2009

Gravatar.com: BnoLHi, nice tut.

But I think every encode script need to have a "password key" so that noone else can decode your ID :) (unless he/she knows your password key).

#6. Topbit on 30 July 2009

Gravatar.com: TopbitIf you only want to use a-z & 0-9 (base 36), base_convert() will convert both ways easily and quickly.

$number = 999999;
$string = base_convert($number, $frombase = 10, 36);
$num = base_convert($string, $frombase = 36, 10);
if ($num == $number) echo "Match!!\n";


There is also a number of other functions there that will do larger number bases - such as 62, using similar techniques as the above post.

#5. Marcelo on 11 July 2009

Gravatar.com: MarceloVery useful. Thanks!

#4. Kevin on 18 June 2009

Twitter.com: kvz@ Gerrit: very interesting, thanks for the heads-up!

#3. Gerrit on 18 June 2009

Gravatar.com: GerritGreat post: I got inspired and changed your code a bit to improve for speed by using int rather than float. This also fixes the rounding problems: try

var_dump(alphaID(alphaID(238328), true) == 238328);

in your converter.

Follow my link for my version of the converter.

#2. devnic on 12 June 2009

Gravatar.com: devnicCool. The best part is that it is a small code that can make the url look more readable and pro.

#1. Đỗ Nam Khánh on 11 June 2009

Gravatar.com: Đỗ Nam KhánhThanks for nice post ^^