mardi 25 avril 2006 par ClarK
Au fur et a mesure de la détection, sachant quelle expression régulière a rencontré le token
désiré on est en mesure de savoir quel est son type.
On peut alors le stocker.
Pour ce faire il faut d’abord découper les tokens déjà récupérés (les balises html et les mots)
suivant des séparateurs afin d’obtenir des tokens plus petits et plus précis, quant à ce qu’ils
représentent, puis d’indiquer avant le token quel est son type (balise, domaine, mot ou bi-mot).
Nos besoins sont de pouvoir stocker un des tokens et le nombre d’occurrences correspondantes. Il s’agit en fait de stocker une paire clé/données dans laquelle la clé est le token (qui est unique) et les données sont les nombres d’occurrences (dans les catégories autorisée et interdite) ce token.
Il n’y a pas de requête complexe à effectuer sur cette base. On veut juste pouvoir stocker la paire et y accéder rapidement lors de l’attribution de score.
Sleepycat Software a développé Berkeley DB qui correspond exactement à nos attentes.
En effet, Berkeley DB permet de stocker des données sous la forme (clé) / (données) dans
laquelle la clé est unique.
Pour ce qui est de la structure nous sommes libre de choisir entre un hash, un B-Arbre, ou une
file. De plus elle permet de gérer la taille de la mémoire tampon afin d’optimiser la vitesse d’accès aux données.
Cet outil semble donc être celui qui nous est nécessaire par ces méthodes de stockage ainsi que ces méthodes d’accès aux données optimisées. Nous arrêterons donc notre choix sur cette base de données.
Cependant nous devons stocker un couple de valeurs par clé, et afin d’optimiser l’espace stockage il faut coder ce couple.
Plutôt que de stocker deux entiers on va coder les valeurs sur quatre octets (deux fois deux octets, soit deux octets par entier) pour stocker d’une par le nombre d’occurrences autorisées et d’autre part le nombre d’occurrences interdites.
Le nombre maximal que l’on peut coder sur 1 octet est 28 - 1 = 255 et on peut coder
28 = 256 valeurs (de 0 à 255).
De même sur 2 octets on peut coder 2562 = 65536 (de 0 à 65535).
Un nombre en base 10 peut donc s’écrire sous la forme :
X10 = a256 + b256.
Ce qui nous donne :
Comme un token n’est compté qu’une fois par page lors de l’apprentissage (et est codé sur deux octets), il faudrait avoir 65536 pages en apprentissage, dans l’une ou l’autre catégorie, pour que la zone mémoire soit dépassée. On a donc une bonne marge de sécurité quand à cette valeur limite.
Nike Air Force 1,Air Force 1 Shoes,Air Force 1 Mid Shoes,Nike Air Force 1 ’07.This article from http://www.af1buy.com/ thank you !
Timberland Sale,Timberland Work Boot,Timberland Boots Sale.This article from http://www.timbershoe.com/ thank you !
GHD Hair Straighteners,Purple GHD Straighteners ,Cheap GHD Straighteners,Pink GHD Straighteners.This article from http://www.ghd-pink.com/ thank you !
UGG Bailey Button,UGG Boots Outlet ,UGG Boots UK,Sale UGG Boots .This article from http://www.whosugg.com/ thank you !
Louboutin Pumps Sale,Christian Louboutin Pumps Sale,Christian Louboutin Pumps Replica,Christian Louboutin Pumps Knockoffs.This article from http://www.christianlouboutinzone.com/ thank you !
Prada Handbags Replica,Prada Handbags USA,Prada Designer Handbags,Discount Prada Handbags.This article from http://www.npbags.com/ thank you !
Herve Leger,Herve Leger 2010,Herve Leger Sale,Herve Leger Bandage,Bandage Dresses,Herve Leger Dresses.This article from http://www.hervedressshop.com/ thank you !
Let’s go into the www.shoeset.com.The Nike Air Max aviation athletic shoes collected somebody slam dunk still more and more big Nike Air Max average !This is participate mainly personally savors with the individuality reason.I thought that the object is : The Nike Air Presto Shoes kind was still required the time in shoes’ matter standard with Nike Air Rejuven8 Mule II to come remarkably to enter his each Nike Free Running Shoes brand shoes Nike to be over-the-rim shot.you whether to know :Nike ACG Sabdals adopts designer’s idea, interest hobby, and in shoes soles life. What the Supra TK Society air technology puts on the aviation Nike Air Shoes line is the spacious each kind of badge, Nike Air Shoes is over-the-rim shot somebody design and the style, provides a better cushion,by base, because further air enters the account, and integrates the human who feels to these.
Discount MBT Shoes are still paying attention to quality.MBT Shoes Sale provide other Brands.Click here to see the Bose Headphones provide all the products you need.
Welcome to www.mbtshoes4clearance.com store, Mbt Shoes Clearance has all part of the new line of MBT athletic shoes. As we know that Mbt Shoes Clearance on sale have a curved pivot sole that copies walking on soft moss.The sole of Mbt Shoes Clearance sale turns even, flat ground into uneven terrain.Cheap Mbt Shoes Clearance are carried forward traditional concepts of Mbt Kisumu Shoes,The unique curved sole works by providing instability and makes the muscles of your body more engaged and also helps burn more calories. Unlike most conventional training shoes that only support and cushion your feet, the inherent instability and the unique rolling action of the MBT Sapatu sole challenges postural muscles to be more active.Mbt Habari Sandals have all the benefits of the Mbt EMA Sandals styles like encouraging you to carry your weight more efficiently, promoting better posture, and creating a pleasant feeling of walking on a sandy beach.Mbt Panda Sandals have a curved pivot sole that copies walking on soft moss. The sole turns even, flat ground into uneven terrain. The Mbt Walking Shoes challenges the muscles to work harder with every step you take. The unique curved sole works by providing instability and makes the muscles of your body more engaged and also helps burn more calories. The Mbt Shoes Lami challenges the hard to reach muscles in your legs, but also works the abdominal, back, buttock, and thigh muscles. With every stride, the instability activates the whole body in concert and tones as it stimulates different areas.Mbt Shoes Sport is part of the new line of MBT shoes which run slightly narrower, and have a slightly different feel. Gentle, active rolling instead of repeated compression leads to relaxed, natural standing and walking. Muscular tensions decrease and the muscles become more balanced. MBT Shoes Fora have all the benefits of the other Mbt Shoes Changa styles like encouraging you to carry your weight more efficiently, promoting better posture, and creating a pleasant feeling of walking on a sandy beach.The The Mbt Chapa Shoes was released in 1996. Wearing Mbt Shoes Chili is like walking barefoot on springy moss or on a sandy beach. If you wearing this Mbt Kaya Shoes, you will feel very comfortable. You can feel Mbt VOI Shoes gait and posture improve significantly relieving the pressure on the joints and back. A multitude of muscles are exercised, both when walking and standing in Mbt Tataga Shoes, which burns calories and stimulates the metabolism. Lets you stimulating weight loss and speeding up regeneration. Mbt Tembea Shoes also have a firming effect on abdominal, leg and buttock muscles.The Mbt Tunisha Shoes designer is Karl Muller. Mbt Barabara Shoes is help people live better, healthier, more active lives. And we believe that living better, healthier and more actively isn’t just about exercise and eating right. Mbt Shoes Shuguli GTX will not only change the way you use your muscles, but will improve the use of your joints and spine. The uniquely designed sole, combined with correct training, achieves a more active and healthy posture and walk. If you wearing this Mbt Fanaka GTX will be the envy of your family and friends.The Discount Mbt Shoes Clearance are in clearance on our store,Womens Mbt Shoes Clearance with Low price and Free shipping !Enjoy the non-taxed purchase. All Mbt Shoes Clearance online for Men are 100% authentic quality and original packing.You should not lose such a good opportunity !It will be the most comfortable walking shoes !
Plutôt pas mal comme article, ça m’a été bien utile. Merci, ClarK.
Seb
—
petits jeux en flash
nfl jerseys youth nfl jerseys custom nfl jerseys cheap nfl jerseys nfl authentic jerseys nfl throwback jerseys
Pittsburgh Steelers Jersey New York Giants Jersey Minnesota Vikings Jersey Baltimore Ravens Jersey Philadelphia Eagles Jersey New Orleans Saints Jersey San Francisco 49ers Jersey Chicago Bears Jersey Dallas Cowboys Jersey Oakland Raiders Jersey New York Jets Jersey Green Bay Packers Jersey Miami Dolphins Jersey
Patrick Willis Jersey Joe Montana Jersey Terrell Owens Jersey John Elway Jersey Jay Cutler Jersey
Brian Urlacher Jersey Walter Payton Jersey Peyton Manning Jersey Marion Barber Jersey Tony Romo Jersey
Jason Witten Jersey DeMarcus Ware Jersey Miles Austin Jersey Ronnie Brown Jersey Dan Marino Jersey
Donovan McNabb jersey DeSean Jackson Jersey Matt Ryan Jersey Eli Manning Jersey Brandon Jacobs Jersey
Aaron Rodgers Jersey Mark Sanchez Jersey Joe Namath Jersey Tom Brady Jersey Bo Jackson Jersey
Joe Flacco Jersey Ed Reed Jersey Ray Rice Jersey Drew Brees Jersey Jeremy Shockey Jersey
Brett Favre jersey Percy Harvin Jersey Jared Allen Jersey Adrian Peterson Jersey Ben Roethlisberger Jersey
Hines Ward Jersey Troy Polamalu Jersey Jack Lambert Jersey Chris Johnson Jersey Larry Fitzgerald Jersey Kurt Warner Jersey
nfl jerseys cheap nfl kids jerseys personalized nfl jerseys throwback jersey cheap nfl jerseys nfl jersey